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ABSTRACT 

Research was conducted to develop a capability for quantification 
and assessrr-nt of in-flight pilot performance for utilization in Under- 
graduate Pilot Training (UPT), This feasibility effort was directed to 
overcoming the disadvantages of the traditional subjective rating of a 
pilot trainee's performance by the instructor pilot. This was 
"accomplished through the development of an automated, objective 
performance measurement system that possesses the characteristics of 
reliability, validity, and sensitivity, A T-3ZB was instrumented to 
digitally record 24 flight and engine parameters. An extensive 
coa^^puter software system was developed with which to reduce, calibrate, 
and analyze the recorded data from the lazy 8 and barrel roll maneuvers, 
and compute performance measures. Criterion values for the two 
maneuvers, were developed by utilizing task analysis data, narrative 
descriptions, and recorded in-flight maneuver performance of a highly 
qualified Air Training Command instructor pilot. Utilizing recorded 
data from 16 students and 4 instructors, experimental performance 
measures were derived through an iterative analytic approach. 

Study results indicated that lazy 8 performance assessment can be 
accomplished using the flight parameters of roll angle, pitch angle, and 
airspeed in a single summary error measure. Barrel roll measurement ? 
is dependent uDon roll and pitch angle, acceleration (g force), and roll 
rate. A definite relationship between roll and pitch was determined to 
be critical to measurement. Discussions of measurement validation 
methods, debriefing plots, a sampling rate study, instrumentation 
techniques, and problem areas are provided. 
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SUMMARY AND CONCLUSIONS 

PROBLEM 

Traditionally, pilot performance has been assessed by aa instructor - 
pilot applying a subjective rating scale which places the student in one 
of several skill categories. Subjective rating is largely a matter of 
judgment and- is subject to many sources of unreliability and invalidity. 
In addition, it places an unnecessary burden on the instructo;- who must 
apply it in-flight, and provides no way of assessing solo performance of 
students or of pilots transitioning to single seat aircraft. The 
purpose of this study was to develop improved methods of pilot proficiency 
assessment which would produce more valid, reliable, and sensitive 
measures of proficiency; and which would free the instructor from 
responsibilities associated with in-flight subjective rating, that 
detract from his attention to instruction and safety. The particular 
problem to which the study was addressed was T-37 pilot performance 
measurement in the Undergraduate Pilot Training (UPT) program. 

APPROACH 

The approach was to develop and implement instrumentation for 
recording T-37 flight data;' and to develop technology and computer 
software for automatically measuring pilot performance using the 
recorded flight data. Twenty-four flight variables were recorded at 
rates of 10 and 100 samples per second using appropriate sensors and a 
data acquisition system which encoded the data in digital form on 
magnetic tape. Software was. developed for calibration of the data and 
for producing an initial condensed print-out for purposed of maintaining 
a continual check on the instrumentation. Automated measurement 
studies, addressing two representative maneuvers, were conducted using 
the calibrated flight data recorded for a number of students and 
instructor pilots. The approach used was to compute measures that were 
initially selected on the basis of Air Training Command maneuver analyses 
and which possessed content validity; then test and, as necessary, revise 
the measures based on experience with the data. Correlation between the 
derived measures ard instructor pilot ratings was also investigated to 
address inter- and intra-rater reliability and to identify measures which 
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consistently failed to reinforce the ordering of performances achieved 
by the rating system. 

RESULTS 

A summary error measure for the lazy 8, based on the flight parameters 
of roll, pitch, and airspeed, was developed. Criteria were based on 
data from skilled pilots, and the measure accounted for 67% of the 
variance in subjective ratings for the data used to formulate criteria. 
In contrast, no significant correlations existed between the measure and 
subjective ratings for student data. Upon investigation, this was found 
to be primarily due to inconsistency between instructor pilots.* rating 
techniques and standards. Using validation techniques which do not 
depend on subjective ratings, face-validity of the error measure as 
applied to student data was demonstrated. Good validation was not 
possible due to lack of sufficient data per individual student. 

For the barrel roll, the parameters of roll, pitch, normal 
acceleration, and roll -rate were used as a data base for measurement. 
It was found that the roll/pitch relationship and not roll or pitch' as 
single variables, is critical to measurement. The constancy of roll 
rate and maximum excursions of normal acceleration are also critical. 
Considerable difficulty was encountered in developing criteria for this 
maneuver due to variance in performance technique. 

Debriefing charts were developed for use in pictorial ly describing 
the performance of each maneuver and conveying measures and diagnostic 
comments to instructor and student. Central charts for both the lazy 
8 and barrel roll consisted of plots of pitch versus roll. 

During the effort, data were collected on the lazy 8, and barrel 
roll (about 160 performances of each), and seven other UPT maneuvers. 
With the major exception of ground-reference data, the variables 
recorded appear to form a sufficient data base for measurement within 
UPT. Techniques were developed for determining required, sampling rates. 
For pitch angle, a rate of one per second was found to ttfe adequate for 
both the lazy 8 and barrel roll. 

vi 
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CONCLUSIONS 

• 

This study achieved its original goals of establishing feasibility 
and developing prototype techniques for automated measurements One 
disappointing aspect of the effort was inability to adequately validate 
results (beyond the content validity inherent in the measures) due to 
lack of sufficient data per student- Future efforts should rely 
heavily on within-subject. sampling for validation of measures; however, 
concurrent validation using subjective ratings is also worthwhile 
investigating so long as it is applied as a necessary (not sufficient) 
test arid results are interpreted with the cautions identified in the 
report. 

The most surprising aspect of the study, and one which essentially 
caused it to require twice the time and effort originally estimated, was 
the level. of effort needed to acquire and prepare for use good in-flight 
data. In part this was due to the prototype nature of the effort, and 
many of the problems encountered can be prevented in future studies. 
However, there are a number of types of problems characteristic of 
in-flight data collection for which details cannot be anticipated. 
Sufficient time and manpower niust be procrammed to take care of such 
problems on an as-required basis. 

Automated proficiency assessment must be blended properly witli 
subjective evaluation of certain primary skills that do not lend 
themselves to automated measurement. Such a system can provide mor£ 
valid and reliable measurement techniques than ever before employed. 
This can greatly enhance pilot selection and training and will also lay 
the groundwork for important research in such areas as simulator-to- 
aircraft transfer^'of training. Future efforts are required to expand 
the technology to other maneuvers in the UPT curriculum and to develop 
similar techniques for other aircraft. 
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SECTION I 
INTRODUCTION 

This report documents a three-year exploratory development effort in 
the area of quantitative assessment and automated measurement of pilot 
performance. The effort involved the instrumentation of a T-37B aircraft, 
collection and calibration of student and instructor performance data, 
and the development of objective measurement techniques for selected 
training maneuvers. 

The development of performance measurement techniques with aTl of the 
appropriate characteristics (objectivity, reliability, etc.) is one of 
those problems which has truly withstood the test of time. Witness the 
following extract from a 1952 technical report (Smith, Flexman, and 
Houston, 1952): 

"An examination of the training program and a survey of 
previews research on pilot training indicate that, for 
the most part, objective standards did not exist and 
that measures of pilot proficiency were not sufficiently 
reliable or discriminating for use as effective criterion 
measures for training research." 

The prevailing truth and existence of statements such as above attest 
not only to the difficulty and complexity of (pilot) performance 
measurement as a research problem, but also to its recognized importance 
over the years. 

The importance of measurement as a research problem is due to the 
fact that measurement is a fundamental requirement which pervades all of 
training, education, and any associated research. It is not possible 
to perform good research in training innovations, for instance, unless a 
valid method exists for measuring the results of training. Neither is 
it possible to optimize training and achieve good quality-control in 
pilot "production" if it is necessary to rely on rudimentary subjective 
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judgments of performance which place a student in one of a few rating 

categories. Much training oriented research of the future can benefit 

considerably from the development of valid performance measurement 

techniques; and some very beneficial research is strictly dependent on 
such developments. 

The above remarks hopefully help to place measurement, as a critical 
problem, in its proper perspective. Despite its criticality, however, 
measurement is largely a means to many ends and not necessarily an end 
in itself. For this reason it is too often treated as a "nice to have" 
but nonessential ingredient in a training or research system, and 
attention is turned to more popular endeavors with more immediate and 
visible dividends. The authors contend that this is why the measurement 
problem. has persisted over tho years — not because it is unsolvable, 
and not because of its difficulty in the context of complex tasks such 
as flying. 

Traditionally, in an introductory section such as this, one would 
address in detail three major topics: (1) the problem, why it is difficult 
to solve, and what characteristics should exist in a good performance 
measurement system; (2) why the problem is important and what the many 
applications of its solution are; and (3) what, if anything, is different 
about the approach used in this study from all of the previously tried 
approaches. The first topic has been discussed at length in literally 
every measurement report published, beginning in the 1940's. (In fact, 
in many reports, discussion of the problem is the essence of the text!) 
It will be treated only in summary fashion in this report. 

The second topic, if addressed completely, could result in another 
technical report. The authors choose to categorize the applications of 
measurement into two general classes and will present just a few 
representative examples of each class. 

The third topic, the approach, covers both the method of acquiring 
data and the methods of treating it. It is the latter of these* which 
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is most controversial. The approach documented in this report is only 
one of those being pursued by the authors. Therefore, in addition to 
summarizing the approach in this Introduction, it is evaluated in Section 
VIII and compared with another, more highly automated approach. 

1. PROBLEM 

From a historical perspective, interest in the measurement of the 
proficiency of aircrew personnel can be traced %the World War I period, 
and the work on the selection of military pilots. Even after these many 
years of '^ndeavor, the measurement and assessment of in-flight pilot 
performance is a long way from being successfully achieved, and less than 
complete information is provided by present measures and methods. The 
measurement of pilot performance is sufficiently difficult due to the 
inherent nature of the human and the environment in which he operates that 
unfortunately, in many instances, the practive has been to obtain what is 
measurable rather than what is desired or required. 

There are* two general methods or approaches in which performance 
measurement can be categorized. The most common is the evaluation of 
performance qualitatively - the subjective method. The second approach 
represents a goal that is the subject of this report, and that is the 
assessment of performance quantitatively — the objective method. These 
two methods are not strictly a dichotomous classification, but rather 
represent a continuum of performance measurement. On the one side there 
exists the strictly personal judgment and rating of performance, and on 
the other end of the continuum is a completely automated performance 
measurement and assessment system. The middle area of this performance 
measurement dimension consists of various techniques whereby the human 
observer may record- performance and then compare this data with pre- 
established standards to provide an evaluation of the quality of 
performance. The desired goal of an effective performance measurement 
system is to capitalize on the advantages of an automated, objective 
system and yet retain some of the unique capabilities afforded by the 
human evaluator so a comprehensive assessment of performance can be 
achieved. 
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a. Requirements of Objective Performance Measurement Systems 

The significant problem in developing an objective pilot 
performance measurement system consists of acquiring data and developing 
analytic and software techniques which derive, from that data, measures 
that are reliable, valid, and sensitive. Also, the practical aspect of 
pilot acceptability must be addressed for such a system to be successful. 
Each of these factors will be discussed in turn. 

(1) Reliability 

Basically reliability refers to consistency or stability in 
the recorded data and computed measures upon repetition. Reliability 
is essential in both the acquisition or recording of performance data and 
in the measuren^ent of performance using that data. When the 
performance of the same individual is scored on different occasions, 
reliability is the opposite of variability. 

Several sources of variability "inherent in cuFtomary measurement 
situations, which hinder reliable measurement of pilot performance, 
include the following (Reference 1): 

1. A major source of variability is a function of variations in 

the environment inr which performance is being measured. Variability 

may be introduced in the in-flight environment by differences in traffic, 

weather, amount of turbulence, wind direction and velocity, visibility, 

etc., producing "between-flying conditions" unreliability. In addition, 

situational factors such as unexpected noise, extreme temperatures, g 

forces, and other distractions may further affect performance scores. 
« 

2. A second source of unreliability is a function of fluctuation 
associated with the operation of the system in which an individual's 
performance is being measured. Variation in scores due to system 
instability may reflect random fluctuations either in the mechanical 
components or in other human components in the system. 
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3- Response-evaluating instruments used and personnel participating 
during proficiency assessment are a third possible source of unreliability 
The equipment used during measurement must be carefully calibrated prior 
to testing. 

4. The fourth source of unreliability is a function of the particular 
sample of items (parameters) selected for inclusion in the test instrument. 

5. The complexity of the behavior being evaluated is a fifth type 
of influence on the reliability of a proficiency measure. Since it is 
possible that an individual's proficiency level may fluctuate considerably 
from one dimension to the next and across time, each component element in 
a sense represents a somewhat different test. 

6. A sixth source of unreliability, is attributable to the change in 
the physiological condition of the pilot himself. This includes 
emotional state, motivation, susceptibility to fatigue and stress, 
variation in the individual rate of adaptation, and many others. 

To minimize unreliability in the data itself, the hardware and 
software components of the performance measurement system require a high ' 
degree of reliability of repeatability. Calibration of equipment must 
be conducted on a continuing basis to be able to determine inaccuracies 
in the data or complete component failure. This includes checking the 
reliability of the power supply output, parameter sensor operation 
regarding resolution, range of values, response rate, and environmental 
effects, recording device operation, and any interface equipment. The 
software processes involved in data reduction, conversion, analysis, and 
plotting should be closely monitored to avoid data loss. Accurate 
records of fligh't conditions and mission requirements should be maintained 
to facilitate the interpretation of the assessed pilot performance data 
based upon the actual conditions under which the performance was flown 
and recorded. 
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The technique of performance measurement, which develops the final 
measures, must (1) eliminate any remaining data unreliability and 
(2) produce reliable measures* There is no standard technique for 
eliminating data unreliability because each case must be treated 
individually depending oo, the source of unreliability* One example is 
in the recording of normal acceleration (g force) using an accelerometer* 
The data are not reliable indicants of sustained acceleration, which 
would expectedly be the focus of interest. Even with filtering, the 
recording would pick up some instantaneous enacts of gust loading* 
Therefore it would not be acceptable to sample this data at discrete 
points. Instead some method of smoothing should be applied to the data 
through the development of appropriate software. 

Of primary importance, ultimately, the measures that are developed 
must be reliable indicies of performance. One example of when reliability 
would not be assured is if unrealistic criteria were applied* A 
derived measure may be considered reliable in that it consistently 
reflects a comparison with the criteria; but it could be an unreliable 
(and invalid) index of performance due to the inappropriateness of the 
criteria. Without proper precautions, it is entirely possible to 
induce unreliability in the measures themselves through improper 
treatment of, what is otherwise reliable-, performance data. 

(2) Validity 

This refers to the degree to which the measuring or testing 
process correctly measures the variable intended to be measured. 
Validity can be categorized into various kinds, but the one that is 
most appropriate to the problem of in-flight pilot performance measure- 
ment is empirical validity. Essentially, this is based upon the 
relation between performance scores and a criterion, the latter being 
a direct indication of perfonnance goals. Criterion-referenced 
proficiency measures permit assessment of performance and provide 
information on the degree of competence considered independently of the 
performance of others. Such measures permt one to determine whether an 
individual has reached a given performance standard, hence, the tei i 
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absolute scoring is sometimes applied. Performance is measured 
against a definitive task specification thet has previously been 
determined either by analysis, subjective judgments by a panel of 
experts, or numerous successful performances, sampled from large 
population. 

I 

In addition tc a criterion- referenced measure or perfonnance standard, 
proficiency measures can also be distinguished as nomi-referencea 
measures. A nonii-referenced proficiency measure evaluates an individual's 
proficiency in terms of a comparison between his performance and the 
performance of other members of the group. Norm-referenced measures 
can be considered a relative scoring method since they are related to. 
level of performance at a selected moment in time during the process of 
learning a specified task. Such measures are of limited value in 
measurements- intended for ^quality control, because they are not referenced 
to fixed performance standards. However, by employing an objective 
measurement system, norm-referenced measures may be of significant 
training value for improving the student's performance through more 
feedback via class competition. Also, the average class performance 
can be readily determined with a norm-referenced measurement system. 

An automated performance measurement system inherently permits the 
assessment of pilot performance to be highly valid, since performance 
can be recorded on-line for numerous system variables. In most in-flight 
evaluations, performance data is seldom recorded until the flight has 
been completed, which introduces inaccuracy simply due to the inability 
of the individual to remember features of performance relevant to 
success. Furthermore, greater detail regarding the perfonnance is 
afforded with an automated system since more flight parameters can be 
recorded and more data accrued per unit of time than is possible with 
human observation. Because of multi-dimensional role of the instructor 
in the in-flight training environment, a serious difficulty can frequently 
occur whereby the instructor's ability to detect and assess subtle 
differences in performance when they, in fact, exist is jeopardized. 
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(3) Sensitivity 

The reliability with which and method by which a measure changes 
whenever tiie pilot's performance changes is known as measurement 
sensitivity. This fundamental requirement for an objective pilot 
performance measurement systen pertains to the fact that performance 
should be discriminated into as many categories of proficiency as possible 
(Whenever feasible, continuous measures of performance should be 
obtained), and the rate of change of the measures with respect to skill 
acquisition must be known. Thus, the sensitivity of the measurement 
system relates to (1) the resolution capability of the sensors to 
discriminate each parameter into values that meaningfully reflect pilot 
performance and (2) the development of measures to an acceptable 
measurement scale; i.e., interval scale. 

(4) Acceptability 

Pilot acceptability becomes a rather important factor when the 
time arrives for making the decision to implement an automated pilot 
performance measurement system that has been proved to possess reliability, 
validity, and sensitivity. Too often, concern is expressed that the 
instructor pilot will be replaced in the training environment by an 
automated device. However, whatever the level of sophistication of 
automated performance measurement, the human observer must always be an 
integral part of the total measurement system. In the complexity of 
flight environment, there are specific behavioral skills which do not 
lend themselves to quantification or objective scoring. It is in these 
areas where the human observer can make more subtle judgments and more 
apppropriate eva^^^ations than is possible with any electromechanical 
device. 

At least the following behavioral factors should and will continue 
to be evaluated by the instructor: 

1. decision making capability 

2. ability to plan effectively 
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3. coordination and smoothness of control 

4* maturity — willingness to accept responsibility, abiriiy to 
accomplish objectives, judgment, and reactions to strssr. , ur.axp^^.cted 
conditions, and aircraft emergencies. 

5. confidence — proportionate with the individM?'i of 
competency 

6. motivation (attitude) — the manner in which it -^flecr^ 
performance 

7. ability to time share attention and efforts appropriately in 
an environment of simultaneous activities 

8 coordination with other crew merr,bers 

9. knowledge and systematic performance of tasks 

10. fear of flying 

11. motion sickness 

12. air discipline — adherence to command authority and jssigne 
tasks. 

The presence of an instructor is required and reconfiiended for in- 
flight training and evaluation* The judgment of the instviJctor 
regarding the student's total flying capability, however > can be 
supported by the objective assessment of psychcmotor skills with an 
in-flight pilot performance measurement system. 

b. Applications 

The applications possible for an automated, objective? pilot 
performance measurement system can be categorized in two '.lascGs: 
(1) applications which enhance flying training in its operacior.ai 
context; and (2) applications which make research possible. 
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(1) Operational Flying Training 

Five examples of how operational flying training can be 
enhanced with an automated measurement system are discussed: 

(a) Inflight Evaluation Enhanced 

The aircraft is a prime example of a complex system where 
the large number of interacting elements lessens the chances of deriving 
reliable and easily interpretable performance measurement data. The 
dynamics of the in-flight environment and complexity of flying, involving 
a large number of procedural, judgmental, and perceptual -motor activities, 
imposes a tremendous burden upon the instructor to assimilate and 
synthesize the student's performance and provide a reliable and valid 
evaluation. Any attempt at manual recording procedures is fruitless 
since the instructor is unable to effectively time-share the activities 
of observing and recording multiple parameters at an adequate sampling 
rate and accuracy to provide the necessary pilot performance measurement 
data. There are many subtle aspects of flying which do not lend 
themselves to recording, and automated performance measurement systems 
normally permit assessment of only those actions by the pilot which 
result in some effect on the aircraft. This permits the instructor to 
concentrate on the evaluation of those qualitative behaviors reflecting 
on the student's ability to effectively and safely cope with the flight 
environment. 

(b) Objectivity Achieved 

In subjective evaluations, considerable variation occurs 
in the performance ratings of the instructors as a function of: 

(1) judgments made without reference to a definitive standard since the 
same maneuver may be flown satisfactorily in a number of different ways, 

(2) different standards of performance which are employed due to 
differences in the instructor's knowledge and proficiency, (3) operational 
flight experience and training affecting the perspective and judgment of 
instructor ratings, (4) performance ratings relating to what the 
instructor deems are the critical aspects of the job, (5) possibility 
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of bias and halo effects existing from the. instructor-student relation- 
ship, (6) different conception of the specific grading system regarding 
the flight parameters incorporated, weighting assigned, and the range of 
the qualitative categories, and (7) difficulty of comparing actual 
performance w^th what the average proficiency level should be at any 
moment in time. Subjective measures generally lack the accuracy 
and reliability needed for effective performance measurement because of 
their dependence upon the judgment and veracity of the individual 
observer. The antithesis of this is an objective measure that is founded 
on data that is free from personal and emotional bias. The greatest 
objectivity is attained when a permanent record of behavior is obtained 
at the time of performance by ^an automated data acquisition system. 

(c) Training Facilitated 

An automated performance measurement system relieves the 
instructor of the burden of in-flight evaluation, and permits him to 
concentrate on the job for which he is most professionally qualified, 
teaching flying. The instructor can devote complete attention to 
developing the. procedural , judgmental, and perceptual -motor skills in 
the student during the flight, which maximizes the effectiveness of the 
training sortie. Additionally, the aspect of flight safety is enhanced 
by reducing the in-flight tasks of the instructor and possibly 
eliminating the requirement for the "head-in-the-cockpit" situation. 

(d) Playback Capability Provided 

Automated performance measurement also provides the means for 
playback of critical mission phases for demonstration and instructional 
purposes. This playback capability can be performed in the simulator 
and even correlated with earlier simulator or aircraft missions. 
Furthermore, it is an excellent method for quantifying the rate of 
learning and affording the opportunity to diagnose consistent weaknesses 
in performance. 

(e) Solo Performance Assessed 

It is also possible to record pilot performance during solo 
flights, which provides the instructor a method whereby he can maintain 
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continuity and assess the stability of performance across dual and solo 
flights. Without an automated measurement system of the type developed 
in this study, it is not possible to assess solo performance, even though 
it is an important criterion. This would include performance in single- 
seat aircraft (e.g., A-7D) as well as regular student solo performance in 
training aircraft. In-flight recording and subsequent automated 
measurement of solo performance will enhance both basic pilot training 
and transition training by providing the first and only means of measuring 
performance of this type. 

(2) Research 

Following are selected examples of capabilities and/or new knowledge, 
the research and pursuit of which will be greatly enhanced when sensitive, 
objective measurement systems are developed: 

1. Replacement of highly sophisticated and expensive simulators 
with lower fidelity and less costly simulators and trainers by having the 
capability to definitively assess the transfer-of-training effects 
(simulator to aircrdft) with regard to the factor of simulator fidelity. 
For example, it would be possible to determine if six degrees-of-freedom 
motion systems and full color and/or field-of-view visual systems 
contribute sufficiently to transfer-of-training to be cost effective. 

2. Replace more aircraft time with simulator time, and know 
the resulting effects on training. 

3. Develop adaptive training methods (impossible without 
performance measurement). 

4. Develop completely automated simulator instruction for use 
in proficiency training. 

5. Accurately predict operational and combat performance of 
pilots based upon their in-training performance. 

6. Improve pilot trainee selection and reduce the wash-out 

rate. 
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c. Immediate Application and Program Genesis 

The need for objective performance measurement has been recognized 
and continually advocated by the Air Force, one of the largest agencies in- 
volved in pilot training. The recognition of this requirement culminated in 
a research request (RTR-68-25-A) directed to the Advanced Systems Division 
of the Air Force Human Resources Laboratory (AFHRL) at Wright-Patterson 
AFB, Ohio, by the Air Training Command. A research project was initiated 
in 1968 entitled Pilot Performance Measurement System to develop an 
in-flight data recording system and a ground-based automated performance 
assessment capability for utilization in UPT. 

2. APPROACH 

The objective of this research effort was to develop prototype methods 
for quantitative assessment and automated measurement of pilot 
performance. The approach to achieving this objective was to (1) develop 
methods of acquiring reliable and accurate in-flight performance data; 
(2) develop methods of measuring pilot performance using the acquired 
data; and (3) perform preliminary tests of the derived methods. In 
scope, the acquisition of in-flight data was designed to be applicable to 
all in-flight performance, but investigation of methods for measuring 
performance using the data was limited to two representative maneuvers: 
the l^zy 8 and the barrel roll. 

Before describing the approach in more detail, it is appropriate 
and necessary to define and clarif^the term "performance measure" as 
used within the framework of this study: 

A performance measure, as the term is used in this report, is a 
number that is selected from or computed from recorded performance data, 
and which, in itself, effects a comparison or directly contributes to 
the drawing of a comparison between (1) actual performance and a 
standard or criterion; or (2) actual performance and the normative 
performance of a selected population. 
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Recorded in-flight data do not necessarily constitute performance 
measures. Similarly, the act of recording in-flight data does not 
constitute the measurement (assessment) of performance. 

With these introductory remarks, we will next describe in outline 
form the approach that was pursued in this study. The approach 
consisted of accomplishing the following tasks: 

1. Developing ^hardware and software required for acquiring and 
calibrating in-flight pilot performance data. 

2. Developing performance measurement techniques and implementim 
them in software. 

3. Collecting extensive data on the lazy 8 and barrel roll and 
some representative data on other maneuvers. 

.. Testing the measurement techniques. 

Each of these tasks will be discussed in turn. 

Acquisition and Calibration of In-Fliqht Performance Data. This 
required the development of hardware and software subsystems. From a 
hardware standpoint, a T-37 aircraft was instrumented to record a 
number of flight and engine variables, such as roll angle, pitch angle, 
stick position, RPM, airspeed, altitude, and heading. This required 
the installation and calibration of a digital flight recorder system 
and parameter sensors such as gyros, tranducers, accelerometers, and 
potentiometers. In addition to initial instal.l'ation of the instrumen- 
tation package, numerous modifications were completed during the first 
several months of use as problem areas were revealed regarding flight 
safety, electrical power distribution, resolution of recorded variables, 
and recording reliability. 

From a software standpoint, computer programs were written to 
(1) convert the aircraft magnetic tape to a tape physically compatible 
with data processing equipment; (2) calibrate the data, or convert it 
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to engineering units; (3) produce a magnetic tape record of the 
calibrated data for use in the njeasurement research; and (4) produce a 
condensed print-out of the data for use in testing the accuracy and 
reliability of • the in-flight recording system. 

Development of Performance Measurement Techniques. This required 
the identification of performance measures and the development, testing, 
and print-out of the measures using the recorded data. The approach to 
accomplishing this was to (1) analyze each of the maneuvers to be 
measured, with particular attention to the ATC published criteria for 
performance; (2) develop a set of theoretical measures based solely 
upon the information in the maneuver analyses; (3) compute the 
theoretical measures for initial representative performances; (4) using 
the initial data, develop a refined set of measures, called experimental 
measures herein, for application to a broad spectrum of student and 
instructor performances; and (5) test the validity of the experimental 
measures and, from them, select final measures for future applications. 

This approach is called (by the authors) an "analytic" approach 
because it is based strongly on detailed analyses of the maneuvers to 
be measured. During the period of the program, an alternative approach 
that is more highly automated was pursued under contract using some of 
the same data collected in this investigation. For this reason, the 
data collection effort, to be described next, was responsive to 
contractual requirements in support of the alternative approach as well 
as to the central requirements of the study as reported in this document. 

Data Collection. The data collection was pursued in three phases. 
Phase 1 consisted of collecting data to establish and verify the 
accuracy and reliability of the in-flight data acquisition and ground- 
based data calibration systems. For this phase, specific performance 
requirements were outlined based on the parameters to be tested during 
each flight. Flight test pilots then flew sorties in accordance with 
the outlined requirements. 
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Phase 2 was devoted to collection of data which supported related 
contractual requirements as well as the requirement for. representative 
instructor pilot (IP) data for this study. For this, a highly qualified 
IP froM the ATC Pilot Instructor Training (PIT) school flew a number of 
lazy S*s and barrel rolls and provided subjective ratings for each 
perfOi^iiiance. As per request, he atteinpted to fly a variety of 
performances to illustrate perfect performance as well as typical student 
errors encountered during this maneuver. 

Pnase 3 was to collect data on students and instructor pilots at 
VHlliams AF5, Arizona. This data v/as required primarily to test and 
validate irisasures, as described below. 

Tes tin g the Measurement Technic{ues. Content validity was built in to 
the measures initially selected for investigation as a result of the 
selection-method employed (i.e.. Air Training Command training and 
evaluation criteria and maneuver analyses served as the bases for 
selection). While content validity is a useful and necessary consideration 
it is not en apriority that it is sufficient in itself. Therefore, a 
number of supplemental validation techniques that are more empirical in 
nature ^'ere also considered. 

One technique that constituted part of the original study design was 
to employ v.'i thin-subject sampling and examine "measure-progress" across 
training. This v/ould provide an additional necessary (but not sufficient) 
validation test in that candidate measures consistently exhibiting zero 
or negative "slope" when plotted against trial-number, for example, 
would be highly subject to question. Conversely, those exhibiting 
opposite charecteri sties would still be considered likely candidates. 
Due to problens discussed elsewhere in this report, sufficient data per 
student v/ere not collected to permit pursuit of this test. 

An alternative supplemental method that was applied in this study is 
that of investigating concurrent validity, which means comparing the 
experimentally derived measures with some other direct and independent 
measure of proficiency. Again, within the context of the subject at 
hand, this validation method must be considered as another necessary 
(v/ith qualifications) but net sufficient test. The reason for this is 
that although an independent measure of proficiency in UPT is readily 
available, 'it Is not as discriminating (sensitive) as the measures to be 
developed: and, since it is based on human judgment, its reliab-^lity must 
he considered subject to question. 
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TKe independent measure most readily available for use "Is the instructor 
pilot's rating of performance, generated on a four-point sca';e (excellent, 
good, fair, unable). Because of the properties of these ratings, as 
outlined in the preceding paragraph, their utility within the context of 
concurrent validation is limited to distinguishing between new experimental 
measures which (a) tend to reinforce the ordering dictated by the ratings, 
and therefore should definitely be considered further, and (b) consistently 
do not reinforce the orderinj, dnd therefore should be considered highly 
subject to question. 

In this report, concurrent validation, in the context described above, 
is explored by analyzing correlations between potential quantitative 
measures and instructor pilot ratings. Summarily, this analysis serves 
several useful functions: (1) it provides a preliminary foundation for 
investigating inter- and intra-rater reliability; (2) it provides data 
which contributes to validity considerations dy flagging measures which 
should be considered highly questionable; and (3) it provides a basis 
for demonstrating where/when derived measures do and do not reinforce the 
ordering achieved by the existing ATC rating system. . (In this last regard, 
where derived measures do not reinforce the ratings, other supplemental 
validation methods that are applied should ultimately be, used to prove 
the derived measures are "correct" — if only for instructor and Command 
acceptance of the new system.) 

3. REPORT OUTLINE 

In this report, the four tasks briefly described above, are presented 
in the order listed. Sections II and III present the hardware and software 
subsystems developed for data acquisition and calibration, and the initial 
tests performed on the system. Section IV presents a sampling-rate study 
done to establish methodology for empirically determining required 
recording rates. Section V describes the development of performance 
measures and measurement techniques to be applied and tested. Section VI 
describes the scope of and methods employed in data collection. Section VII 
describes the analyses and tests performed on the measurement techniques 
and presents the results derived. The last. Section VIII, sumnarizes the 
findings. 

For the casual reader interested in a good overview of the research 
effort at the expense of all details, it is recommended that attention 
be focused on Sections II, III, VII, and VIII. 
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SECTION II 
AIRBORNE DATA ACQUISITION SYSTEM 

1 . T-37B AIRCRAFT 

A T-37B aircraft with a USAF tail number of 58-1948 (hereafter 
referred to as 948) was bailed to the Air Force Systems Command (AFSC) 
by the Air Training Command (ATC) to support the research requirements 
of the AFHRL Pilot Performance Measurement System Program, 

a. Aircraft Description 

The T-37B is a low-wing, twin-engine jet trainer with side-by- 
side seating (student pilot flys from the left seat). Manufactured by 
Cessna, the aircraft has a gross weight of 6600 pounds and an internal 
fuel load for a normal training mission duration time of 1 hour 15 minutes. 
The aircraft includes full instrumentation for IFR flight. Figure 1 
represents the cockpit arrangement of 948. The dual-control flight 
control system is manually operated with an electrical trim tab system 
for the ailerons, elevator, and rudder. The aircraft has full 
aerobatic and sDin capability with a g-load limitation of +6.67 and 
-2.67 g's. (A +4g limitation was imposed during a large percentage of 
the research program flights due to structural problems in the T-37 fleet.) 
Airspeeds for the aircraft are: takeoff at 90 knots; a maximum of 
382 knots; a final approach speed of 100 knots; and a touchdown speed 
of 75-80 knots. Some of the noteworthy operational features the T-37 
affords are excellent out-of-the-cockpit visibility, good handling 
characteristics, and high reliability. 

b. Role of T-37 in UPT 

The T-37 has proved to be a valuable training vehicle in 
Undergraduate Pilot Training (UPT). Introduced into the Air Force 
primary flying training program in 1957, UPT students fly the T-37 for 
approximately 90 hours. The performance and handling characteristics of 
the T-37 provide an excellent medium through which UPT students can 
progress from a low-performance and a simple-mission aircraft (T-41) to 
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a high-performance and more operationally oriented mission aircraft 
(T-38A). 

Utilized principally for contact (VFR) flying training, basic 
instrument training, and some navigation and formation flying, the T-37 
flying training curriculum outlines a total of 68 sorties (55 dual, 
13 solo). The contact phase of the T-37, with which this research 
program was solely concerned, specifies that 42 sorties (29 dual, 13 solo) 
will be flown in 54.7 hours. The instructional units contained in the 
contact phase include: aircraft familiarization, fundamental maneuvers 
(stalls, spins, traffic pattern), supervised solo flights, area checkout, 
advanced (arobatic) maneuvers, night flying, and check flights. 

The role of the T-37 in UPT is presently undergoing minor revision 
through a reduction in emphasis and the number of flying hours in specific 
areas of the UPT curriculum. 

c. Flight Test Support 

In May 1968, the T-37 (948) was transferred to Wright- 
Patterson AFB, Ohio, and placed under the operational control of the 
Directorate of Flight Test of the Aeronautical Systems Division 
(currently designated the 4950th Test Wing). Flight Test responsibilities 
for supporting the aircraft and the research program included: 

1. Assigning a Test Director to coordinate all Flight Test 
support agencies and AFHRL research requirements with regard to the 
instrumented aircraft, 

2. Engineering design, installation, calibration, and 
maintenance of the data acquisition system. 

3. Maintenance for the T-37 aircraft. 

4. Providing a qualified test pilot and a scheduling service 
for the equipment calibration and data collection flights. 
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5. Computer data reduction support by processing the one inch 
aircraft magnetic tape and producing a one-half inch IBM compatible tape. 

6. Photographic documentation of the project. 

7. Radar flight following during the missions. 

2. AIRCRAFT INSTRUMENTATION 

The T-37 948 was instrumented with a data acquisition system by 
Flight Test at Wright-Patterson AFB. This equipment installation was 
considered to be a Class II modification, which is a temporary change to 
the standard configuration of an aerospace vehicle that is essential to 
the successful accomplishment of research, development, test, and 
evaluation (RDT4E) program in compliance with AFR £0-14 and AFSCR 80-23. 
However, the Class II modification did not place any restrictions upon 
the operational capability of the aircraft with regard to IFR flight, 
aerobatic maneuvers, or other UPT training maneuvers. All engineering 
design, installation, maintenance, flight safety, and quality control 
functions were accomplished in the same manner as if the data acquisition 
system were a permanent installation in 948. 

a. Recorded Parameters 

Upon activation by the instructor pilot, the data acquisition 
system recorded pilot performance on 17 continuous and 7 discrete flight 
and engine parameters. An additional 8 parameters were obtained via 
computational techniques from the 24 recorded parameters. Table I 
provides (1) g listing of each of the 32 recorded and computed parameter-;, 
(2) the aircraft component or system from which the recorded values 
originated, (3) the sensor that converted the various forms of flight 
or engine data into the correlated changes in electrical output to the 
magnetic tape recorder, (4) the range of values for each recorded 
parameter, (5) sampling rate that the data was recorded, and (6) the 
resolution or sensitivity achieved. 
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Since the research program represented a study in feasibility 
throughout, the parameters selected for recording do not necessarily 
represent an optimum set to reflect in-flight pilot performance. Rather, 
the instrumented parameters signify an initial attempt, based on 
experience and intuitive judgment, at evolving a meaningful set of 
variables from which performance measures could be developed to assess 
actual pilot performance. To be precise, the parameters listed in 
Table I have previously undergone several iterations of analysis and 
modification. The effectiveness of these parameters with regard to the 
characteristics of reliability, validity, and sensitivity in recording 
in-flight pilot performance is contained in a later discussion that 
concludes Section II. 

b. Sensor Systems 

The selection of sensors for each of the recorded parameters was 
based on the estimated resolution requirements for conducting pilot 
perfonnance measurement research. With the exception of the altitude, 
g, pitch rate, and roll rate parameters, those flight and engine measures 
have either equalled or exceeded the predetermined resolution require- 
ments. It is necessary to point out at this time that some of the 
recorded parameters were discarded by the authors early in the develop- 
ment of performance measurement techniques as not being applicable to 
the maneuvers being investigated. Thus, the determination of the 
resolution achieved from these unessential parameters was not pursued. 

The sensors and recording equipment were strictly off-the-shelf 
components that had proved to be reliable in previous Flight Test 
projects. Table II presents a description of the dimensions, weight, 
power requirements, and cost of the equipment installed in 948 that 
comprised the data aG<?uisition 'system. The approximate physical 
location of the equipment installed in 948 is indicated in Figure 2. 
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The following is a cursory description of the recorded parameters 
including the components employed in the sensor systems and the displays 
provided to the pilot in the cockpit: 

(1) Heading 

The T-37B aircraft normally contains a J-2 slaved directional 
gyro system. However, due to excessive precession errors and a basic 
lack of responsiveness encountered during calibration flight tests when 
performing high pitch and bank angle maneuvers (e.g., lazy 8 and barrel 
roll), a J-4 compass system was substituted in 948. The J-4 system 
added the capability for (1) latitude correction, (2) a synchronizer 
switch to provide a normal means of orienting the gyro to the signals 
from the remote compass transmitter, and, most importantly, (3) a 15- 
second fast slave cycle that could be induced whenever the function 
selector switch was moved from the MAG (magnetic) to the DG (directional 
gyro) position and returned to MAG by the instructor pilot. A synchro- 
follower provided the signal output from the compass to the Pulse Code 
Modulation/Data Acquisition System (PCM/DAS). The heading system was 
excited by +5 volts DC over a range of 0-360*" with approximately 0.0128 
volts representing T. The effective resolution achieved was +r from 
the cockpit instrument, which consisted of a standard T-37 heading 
indicator with a fixed card and rotating needle. A heading set knob 
permitted the compass card to be rotated by the pilot. 

(2) Altitude 

A Model 7000 altitude transducer manufactured by Computer 
Instruments Corporation provided a signal output to the PCM/DAS for 
aircraft pressure altitude. The altitude transducer was linked directly 
with the normal aircraft pitot-static system. With a voltage output of 
+5 DC over a range of 0-30,000 ft, each 100 ft was represented by 
approximately 0.0150 volts. The effective resolution achieved with the 
parameter of altitude varied between 139 and 18^ ft error on the data 
collection flights with a mean resolution of ±165 ft. A standard 
three-pointer altimeter was located on the left side of the cockpit 
with which the transducer was correlated. 
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(3) Airspeed 

The airspeed signal to the PCM/DAS was transmitted by a 
Model 7100 Computer Instruments Corporation airspeed transducer. 
Connected to the pitot-static system of the aircraft, the +5 volt DC 
transducer output covered 0 to 350 knots IAS with approximately 0»0118 
volts representing 1 knot. The resolution achieved was a fairly constant 
error of +2 knots from the standard airspeed indicator on the left side 
of the cockpit. 

(4) Pitch and Roll Angles 

The T-37 has an attitude-indicating system consisting of a 
MD-1 vertical gyro and a MM-3 attitude indicator located on the left 
instrument panel. Due to the possibility of affecting the safe 
operation of this system by attaching a synchro-follower, a second MD-1 
gyro was installed in 948 that provided a +5 volts DC output from the 
synchro-follower directly to the PCM/DAS. Within the pitch limitation 
of the gyro of ±82*^, an effective resolution of +1.5*^ of the pitch angle 
as indicated on the MM-3 attitude indicator was achieved. Approximately 
0.0144 volts represented 1*^ of pitch attitude. The roll angle parameter 
had a full 360^ capability from the gyro and a resolution error of +^1.5'' 
from the indicated bank angle. A voltage output of 0.0143 represented 
1*^ roll angle. 

It)) Acceleration (g Force) 

Acceleration along the Z axis of the aircraft was sensed by a 
separate accelerometer that was installed in 948 and correlated in-flight 
with the standard g meter located in the center of the instrument panel. 
With a +5 volts DC output from the accelerometer to the PCM/DAS, 
approximately 0.140 volts represented O.lg. An effective resolution of 
+p.3g was obtained with the parameter system. 
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(6) Pitch, Ron , and Yaw Rates 

A single unit containing rate gyros for the pitch, roll, and 
yaw axes was installed and powered by 115 volt, 400 cycle, single, phase 
AC. The outputs from the gyros were transmitted through a Signal 
Conditioning Unit to the PCM/DAS. Pitch rate was represented by 
approximately 0.0553 volts DC for T per second over a range of 0-90" 
per second. Roll rate was represented by approximately 0.0259 volts 
DC for r per second over a range of 0-180° per second. Yaw rate was 
represented by approximately 0.0680 volts DC for T per second over a 
range of 0-70" per second. The resolution achieved on these three 
parameters was not empirically ascertained because of the lack of a 
cockpit indication with which to compare the accuracy of the rate gyros 
in-flight. 

(7) Longitudinal and Lateral Stick Position, Rudder Position 

The pilot's movement of the aircraft control stick and rudder 
pedals was recorded by linking "pots" (potentiometers) to the elevator 
cable, left aileron cable, and rudder cable that produced a +5 volt DC 
signal to the PCM/DAS. The longitudinal stick position had a range of 
-15" for forward stick (elevator down) to +25" for aft stick (elevator 
up) with approximately 0.1238 volts representing 1" of elevator travel. 
The lateral stick position had a range of +16" in which 0.1526 volts 
represented 1" of aileron travel. Rudder pedal input had a range of 
+24" so that 0.1027 volts represented 1" of rudder travel. 

(8) Engine RPM 

The RPM of the left and right engines was recorded by 
linking frequency converters to the tach generators. Approximately 
0.0500 volts represented U RPM for the left engine and 0.0400 volts for 
the right engine over a range of 0-100%. A somewhat constant resolution 
error of -1% RPM was achieved when compared with the two tachometers on 
the center instrument panel in the cockpit. 
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(9) Throttle Position 

The left and right throttle positions were recorded by a 
+5 volt DC output from pots linked to the throttle. With a range of 
0-64'' from the CUTOFF position to 100% engine RPM, approxim-^tely 0.0689 
volts represented movement for the left throttle and 0.0659 for the 
right throttle. 

(10) Flaps 

The position of the wing flaps was recorded by a pot output 
of +5 volts DC that was linked to the flap indicator signal to the cockpit 
instrument. With a range of 0-100% (0-40''), 1% of flap movement was 
represented by approximately 0.0475 volts within 1% resolution. 

(11) Landing Gear, Speed Brakes, Thrust Attenuator, 

'ator Trim Tab Up and Down 

I he operations of these systems were recorded as discrete 
events by linking the switch signal directly to the PCM/DAS. 

A complete listing of the calibration data for the recorded flight 
and engine parameters may be found in Appendix I. 

4 

c. Recording System , 

» 

The actual recording of the parameter data transmitted by the 
various sensor systems was accomplished by two components, an analog-to- 
digital converter and a digital tape recorder. 

(1) Analog-to-Digital Converter 

A Pulse Code Modulation/Data Acquisition System (Model 101) 
manufactured by Brown Engineering Co. (Reference 2) converted the analog 
signals from the sensors to a digital format and transmitted the output 
to the magnetic tape recorder. The PCM/DAS possesses the functional 
capability of (1) accepting up to 30 analog signals varying between 
+5 volts, (2) sampling 6 of these analog signals at 100 times per second 
and the remaining 24 at 10 times per second, (3) converting these analog 
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signals to a 10-bit digital representation plus a sign bit, (4) providing 
an output format containing 98 data words and 2 sync words per master 
frame (major cycle), and (5) generating a binary coded decimal (BCD) 
representation of the elapsed time in hours, minutes, and seconds from a 
stable time reference. 

(2) Digital Tape Recorder 

A 16-channel Leach tape recorder (Model MTR-3200) recorded 
the PCM/DAS digital signals on a 1-inch magnetic tape. Powered by +28. 
volts DC, the tape recorder was operated at a speed of 7-1/2 inches per 
second. The tape capacity of 3/4 mil and 2,400 feet loaded on an 8-inch 
reel provided 60 minutes of recording time. The recorder unit was 
located in a lower fuselage bay area with a remote control unit in the 
cockpit. 

(3) Cockpit Recorder Control Panel 

The acquisition of in-flight pilot performance data was 
controlled by the instructor pilot (in the right seat) through the 
operation of the magnetic tape recorder with the Recorder Control panel. 
This control unit shown in Figure 3 was located between the ejection 
seats in an area formerly occupied by a map and data case. A description 
of the Recorder Control Panel switch functions (left to right and top to 
bottom) follows: 

(1) MASTER SW (ON-OFF) - controls power to the entire data 
recording system. 

(2) INVERTER 

(a) red FAIL light - illuminates to signal inverter 

failure. 

(b) ON-OFF switch - 115-volt, 400-cycle, single-phase 
AC power supply which provided 5 volts DC excitation for all the pots. 

(3) COUNTER - three-digit counter that continuously codes 
record number on the tape. 
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(4) GR0UND-TC-FLI6HT guarded switch. 

(a) OFF (guard up) - permits local manual operation of 
recorder on the ground for purposes of checkout, tape loading, and 
maintenance. 

(b) ON (guard down) - recorder in remote mode controlled 
only by adjacent RECORDER POWER and CONTROL switches. 

(c) green light - illuminates when recorder is set for 
remote cock^U operation. 

(5) TAPE RECORDER controls 

(a) left amber light - illuminates when recorder is ready 
for data recording and extinguishes during tape operation. 

(b) right amber light - illuminates when recorder is 

operating. 

(c) POWER switch (ON-OFF) - provides 28-volt DC power to 

Lap: recorder. 

(d) CONTROL switch (ON-OFF) - operates tape recorder for 
data acquisition purposes. v 

(6) PCM/DAS (ON-OFF) - provides 28-volt DC power to the Pulse 
Code Modulation/Data Acquisition System. 

(7) TIME CODE switch 

(a) START - inputs a continuous time signal to the tape. 

(b) OFF position resets the clock to zero. 

(8) PILOT EVENT button - permits momentary coding on tape of 
a significant event when depressed. 
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(9) AUTO. CAL* button - initiates an automatic 300-millisecond 
internal calibration program sequentially on each scoring parameter* 

(10) PCM/DAS POWER fuse - a 1-1/2 amp fuse protecting the system. 

(11) RECORD NO. - advances counter one number when depressed. 

Just aft of the Recorder Control Panel is located the J-4 Compass 
System Control Panel which contains the following switch functions: 

(1) DEC/SET/INC Synchronizer Sy^itch - permits manual slaving of 
the gyro to the signal from the remote compass transmitter by using the 
MAG annunciator window as a slaving reference. 

(2) DG/MAG Function Selector Switch 

(a) operates in a non-slaved mode by selecting the DG position. 

(b) operates as a slaved heading system in the MAG position 
by using the signals from the remote compass transmitter located in the 
left wing tip. 

(c) a 15-second fast slaving cycle is induced when the 
function selector switch is moved from the MAG to DG position and 
returned to MAG. 

(3) Latitude Correction Knob (LAT) - reduces the apparent 
precession caused by the higher latitudes when operating in a nor-slaved 
mode. 

A J-4 POWER switc>i was installed adjacent to the J-4 Control Panel to 
provide system power. 
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(4) Audio Tape Recorder 

A Norelco portable audio tape recorder (Model 150) was utilized 
to record all interphone and UHF radio communications in the aircraft. 
The transistorized recorder operated on five 1.5 volt (C cell) batteries 
at a tape speed of 1-7/8 inches per second that provided 30 minutes' 
recording time on each side of the C-60 cartriage. A holder was installed 
on the right sidewall of 948 (see Figure 1) in which the recorder was 
placed during the flight. A "Y" cord was locally fabricated that would 
interface between the normal aircraft interphone jack and the tape 
recorder. 



(5) System Effectiveness 

The effectiveness of the data acquisition system must 
ultimately be evaluated in terms of the capability it provided in the 
development of measurement methods and the quantitative assessment of 
in-flight pilot performance. This system effectiveness is directly 
related to the three fundamental requirements of an objective pilot 
performance measurement system - reliability, validity, and sensitivity. 

The data acquisition system. overall provided a degree of reliability 
that was considerably better than was originally expected. Many of the 
problems encountered early in the program during the calibration flights 
were corrected by modifications and improvements to the sensor systems 
and power supply. The subsequent data collection flights conducted at 
Williams ARB, Arizona, with students and instructors were virtually 
unhampered by equipment failure in the instrumentation package. The 
Leach magnetic tape recorder did cause some difficulty occasionally that 
was usually corrected by cleaning the tape head. At one point in the 
student data collection phase, the tape recorder had to be returned to 
the manufacturer's facility for overhaul. 

A rather serious problem was experienced throughout the entire 
Pilot Performance Measureii^ent Program with the heading parameter. As 
stated earlier, 'a J-4 compass system was substituted for the normal J-2 
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system In the T-37 due to excessive precession errors with the original 
system. This change was quite valuable since the 0-4 system proved to 
be more stable and any precession encountered during the flight could be 
quickly eliminated by manually inducing the fast slave cycle between 
recorded maneuvers. However, inherent limitations uf the heading sensor 
system with the synchro-follower permitted the accurate recording of 
heading (jj"*) only in the southeast, southwest, and northwest quadrants, 
or specifically between 090 and 360''. Anytime the aircraft turnei to 
the northeast (360-090''), the recorded data was erroneous. This neading 
restriction could be compensated for somewhat by performing the maneuvers 
on southern and wes.terly headings. Unfortunately this was not always 
possible due to the constraints imposed upon the aircraft operations by 
the ATC airspace requirements. Although the parau.eter of aircraft 
heading was the primary reference variable in the lazy 8 maneuver, the 
lack of full 360'* recording capability inhibited the development of 
performance measures and forced the authors to eliminate it as a measure- 
ment variable. 

The sensitivity achieved from altitude was somewhat less than the 
predetermined requirement of 50 ft, but the actual altitude error of 
+166 ft w^s still sufficiently accurate to permit meaningful measurement 
research on the lazy 8 and barrel 1 roll maneuvers. However, for other 
types of maneuvers, such as the 360'' overhead traffic pattern, the 
altitude error would have to be reduced considerably before appropriate 
perfonnance measures could be developed. The altitude error encountered 
appeared to vary to some extent from one day to the next, perhaps as a 
function of temperature or humidity. Generally the altitude recorded 
from the surface of 5500 ft was leis than the actual mean sea level 
altitude of the aircraft. At approximately 5500 ft, a crossover 
occurred such that the recorded altitude became greater than the actual 
altitude of the aircraft (positive error), and the error increased 
slowly but progressively as a function of increasing altitude. The 
altitudes between 2500 and 8500 ft resulted in the most accurate data on 
aircraft altitude. 
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Initially, it appeared the gyro limitation of +82° would pose a 
problem for the accurate recording of pitch angle; but, subsequent student 
data collection flights revealed the maximum pitch angle for the two 
primary maneuvers of interest did not exceed 70''. Thus, the attitude 
gyro was quite satisfactory regarding the range of values sensed as well 
as the +K5° resolution from the indicated pitch and roll angle. In the 
over-the-top maneuver such as loop, clover-leaf, Immelmann, etc., the 
vertical limitation of 82'' affected the capability to accurately 
reconstruct the actual maneuver. Of course, the 360° noil capability 
of the MD-1 gyro and a resolution of +1.5° bank angle provided accurate 
performance data on that parameter irrespective of the maneuver performed. 
It was possible to experience some degradation in the accuracy of pitch 
and roll data whenever insufficient time was allocated between maneuvers 
with large pitch and roll excursions. An attitude fast erection system 
switch CP the instrument panel could be activated within certain 
operational limitations by the pilot whenever the attitude indicator 
was precessed excessively. 

The parameters of acceleration (g force), pitch rate, roll rate, and 
yaw rate were quite adversely affected by turbularce and gust loads. 
Large spikes in the data indicated the sensor systems of these four 
parameters were too sensitive for accurate recording of in-flight data. 

With respect to the validity of the in-flight pilot performance data, 
the basic philosophy adopted was that the recorded values should 
correlate as closely as possible with the values displayed on the 
respective cockpit flight or engine instrument from which the pilot 
derived his information. Thu5, there was less concern regarding a 
minimal error existing between the actual parameter value and instrument 
reading than aay error encountered between the instrument reading and 
recorded value. However, the cockpit instruments of the more 
sion.ificant f-arameters (e.g., ^leading, altitude, and airspeed) were 
calibrated by bench checks, tower fly-bys, and pacer aircraft flights 
to ascertain their real -world accuracy and the extent of inherent errors 
existing that affect the instrument indications such as mechanical error. 
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scale error, installation/position error, reversal error, and hysteresis 
error. 
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SECTION III 
GROUND-BASED DATA CALIBRATION SYSTEM 

1. OVERVIEW 

Considerable data processing and logistics effort was required to 
convert the recorded flight data into a form suitable for research and 
analysis. The physical characteristics of the flight recorder tape made 
it incompatible with the data processing equipment available for extensive 
data analysis. This necessitated an initial conversion of the data to 
IBM-compatible tape. The operating system characteristics of the data 
processing installation supporting the study made necessary a reformatting 
of data prior to calibration. Also, the quantity of data involved 
necessitated the development and rigid adherence to an extensive data- 
cataloging system. 

While these requirements are not necessarily unique to this particular 
study, they were complicated by the fact that different sources had to be 
used for various portions of the data processing effort. The initial 
conversion of the data to IBM-compatible tape was accomplished by the 
ASD Flight Test Data Reduction Branch, whereas all subsequent data 
processing work was done by the ASD Computing and Information Systems 
Branch using different equipment. Among other things, this amplified 
problems inherent in reading and writing magnetic tape. In addition, 
data analysis requirements, as anticipated, varied as the research 
progressed, and several different programmers were subsequently involved. 
This resulted in more data-passes than desired and, to enhance reliability 
and simplify data handling, necessitated the transfer of individual flight 
maneuvers data to cards. Figure 4 illustrates the general flow of data 
and the order in which various processing and research tasks were 
accomplished. 
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FINAL 
MEASURES 




Figure 4. Flight Data Processing Flow 
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2. TAPE FORMAT CONVERSION 

a. Recorder Tape 

The flight data, as it appears on the recorder tape, consists of 
successive frames of 100 words each. . The 1st and 100th words of each 
frame are sync words, the 2nd through 97th words are data words, and the 
98th and 99th are time words. 

The tape is 1 inch wide and has 16 tracks (14 recorded). Figure 5 
illustrates the information format and the order of the recorded 
variables stored repeatedly in each 100-word frame. Each frame 
represents 0.1 seconds of data. Since the recording speed of the tape 
is 7.5 inches per second, the data density on the tape is 133 bits per 
inch (BPI) per track. 

The recorder tape is read on an Ampex FR-1200 recorder-reproducer, 
processed through a DDP-24 system, and written on 1/2 inch processor 
tape. 

b. Processor Tape 

As it appears on the processor-tape, the flight data are 
formatted in 1230-word records, each word of which has a parity bit 
(bit 1), sign bit (bit 2), and ten magnitude bits (bits 3-12). There 
are 12 frames of 100 words apiece, each preceded by 2 frame-delineation 
words (7777g, 7777g). The first two words of each record are the record 
number, and the last four words contain all zeros. The record length 
of 1^30 12-bit words makes it possible to convert each record into 410 
36-bit words for compatibility with the IBM 7094. The processor tape 
density is 556 bits per inch (BPI). 

c. Blocked Tape 

All operations on the data subsequent to the conversion from 
recorder to processor tape were accomplished using a 7094/7044 Direct 
Coupled Computing System (DCS). In the DCS, the IBM 7044 computer 
processes all input/output, and the system requires that magnetic tape 
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1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 



LSB 



} MAGK'llUOK Of fJATA^KCili' 



MSB 
SIGN 

PARITY (lVEN) 

CLOCK PULSt- (EVLHY 'Md) 

FRAME PULSE (FVERV 0.1 -.r ' 

UNIJSRD 



100 WOI^OS 



WORD VARlABLf. 

1 Sync 
2-7 lOO/Ssc Uot-dv 

Pitch, Roll , ic-oq. 
Stick Position, Lat. 
Stick Position. 
Rudder Position. 
Airspeed 
8 Thrust AttenoatO'" 

9-11 None 

12-17 100/Sec Words 

18 Roll Rate 

19-21 None 

22-27 100/Sec Words 

28 None 

29 Trim Fab Up 

30 Trim Tab Down 

31 None 

32-37 100/Sec Words 

38 Altitude 

39 Heading 

40 Yaw Rate 

41 Accel elation (n ^"urce) 



60 

(A 

U 0 



PH 

!C') ^ 'J^ivi 



41 



AFHRL-TR-72-6 



input be blocked into successive 460-word records. Therefore, a 
blocked tape had to be prepared from each processor tape prior to 
beginning calibration and other computations. 

To generate the blocked tape, the 12-bit words on the processor tape 
were picked up thre^a at a time to form 36-bit 7094-compatible words. 
These words were written onto the blocked tape in binary records of 460 
36-bit words at a density of 800 BPI. 

3. CALIBRATION 

a. Calibration Data and Procedures 

Calibration of the flight data required a conversion of each 
recorded digital number to volts, then a conversion from volts to 
parameter values. For the conversion to volts, the following formula 
was applied: 

Volts = 0.0051281 (recorded number) - 0.1256 

This formula was derived from data published in a Brown 
Engineering manual (Reference 2). 

For conversion from volts to parameter values, calibration data 
derived by instrumentation personnel were used. An attempt was made to 
curve-fit the calibration data using (1) a single linear fit for each 
set of calibration data as well as (2) a quadratic fit. The fits were 
evaluated by a comparison with data obtained through linear interpolation. 
Considering the magnitude of the errors obtained with either type of 
curve fit (see Table III) and considering the likely (and eventually all 
too true) requirement of frequent alterations to the calibration data, 
it was decided that linear interpolation must be used. 
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TABLE III 

ERRORS OBSERVED IN TRIAL ATTEMPT TO CURVE-FIT 
CALIBRATION DATA 



Word 


Maximum 


Error 


Units 


Quadratic fit 


Linear fit 


Pitch 


1 47 


1 M 

1 . U7 




Roll 


.61 


58 




Stick 








Pos. (Long.) 


.48 


1.54 


Deg 


Stick 








Pos. (Lat.) 


.82 


.87 


Deg 


Rudder Pos. 


1.25 


1.61 


Deg 


Airspeed 


6.47 


11.02 


Knots 


Roll Rate 


2.04 


23.80 


Deg/Sec 


Altitude 


31.48 


1572.07 


Ft 


Yaw Rate 


15.45 


15.45 


Deg/Sec 


Acceleration 


.62 


.64 


g's 


Flap Pos. 


2.58 


4.95 


Percent 


Throttle (LH) 


1.12 


.99 


Deg 


Throttle (RH) 


1.93 


2.27 


Deg 


RPM (LH) 


.14 


.34 


Percent 


RPM (RH) 


.53 


.52 


Percent 


Pitch Rate 


6.73 


6.89 


Deg/Sec 
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Aopendix I shows the calibration data and calibration block diagram 
for all recorded variables except (1) discrete variables, (2) event 
number, and (3) time.' The calibration data were stored on cards to 
simplify updating and were read into the 7094 and interpolated linearly 
to effect the calibration. Discrete variables were converted to 1 if 
volts were greater than or equal to 2.5, and to 0 otherwise. No - 
calibration was required for the event number. Time is recorded on the 
flight tape as a type of BCD quantity and required special treatment for 
conversion to hours, minutes, and seconds. As recorded, time consumes 
two 12'bit words, with individual bits therein weighted BCD as follows: 

BIT: I 2 3 4 S 6 7 8 9 10 II la 
TIME WORD I : ^ I j j 

weight: 20 10 8 4 2 I 40 20 10 8 4 
% ^ f s ^ f 

HOURS MINUTES 



TIME WORD 2 



BIT: 12 3 4 5 6 7 8 9 10 

weight: 



l^ >40 20 10 8 4 2 ,^ 



12 

El 



MIN, 



SECONDS 



During the calibration run, time was converted to seconds by 
appropriately adding products of weights and bits as indicated above, 
multiplying the result by 60, in the case of minutes, and 3600, in the 
case of hours, and summing. 



b. Computed Variables 

Some additional variables were computed from the recorded flight • 
data at the time of data calibration. The computed variables are 
sumjTiarized in Table IV. The first five variables in the table were 
computed because they were believed to be potentially useful in measure- 
ment. Pitch, roll, and yaw angles were computed solely as a check on 
the recorded pitch and roll values arid the recorded body-axis rates. 
Time was computed as a check on the recorded time and the sampling 
frequency. 
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TABLE IV 
COMPUTED FLIGHT VARIABLES 



Variable 

1. Vertical Velocity 

2. Longitudinal Stick Rate 

3. Turn Rate 

4. Lateral Stick Rate 

5. Rudder Rate 

6. Pitch 

7. Roll 

8. Yaw 
Time 



Computed 
From 

Altitude 

Longitudinal Stick 
Position 

Heading 

Lateral Stick 
Position 

Rudder Position 

Pitch Rate 

Roll Rate 

Yaw Rate 

Recording 
Frequency 



Using 



Numerical 
Differentiation 



Euler Angles & 
Numerical 
^ Integration 



Cumulative 
Summation 
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Unfortunately, little use could be made of any of the computed 
variables with the exception of time. The primary reason was because 
spurious "glitches" in the data destroyed computational continuity. In 
addition, numerical differentiation amplified all noise and thereby 
rendered the variables computed useless. Some experiments with other 
methods of computation were attempted. However, the importance and 
urgency of other problems to be contended with and the main research to 
te conducted quickly forced abandonment of the computation of additional 
variables during calibration. It was decided that such computations, 
if required, should be attempted only after smoothing of the data. 

c. Calibrated Tape Format 

As recorded on the calibrated tape, each data word is an 
IBM 7094 36-bit floating point binary word, with a sign bit (bit zero), 
8-bit exponent field (bits 1-8), and 27-bit mantissa (bits 9-35). 
The data are recorded on 1/2 inch, 7-channel magnetic tape at a density 
of 800 BPI. Record length is 460 words, with words 1, 2, and 460 used 
as control words meaningful only in connection with the 7094/7044 DCS, 

The data are placed on the tape in successive groups, each group 
representing all data for 1.2 seconds of real time. The order of the 
data*as it appears on the tape is illustrated in Table V. All data 
recorded at a sampling rate of 100 per second appear first, e.g., the 
first 1.2 seconds of pitch data,. or 120 samples of pitch, appear first, 
followed by each of the remaining 100 per second sampled variables. 
Data recorded at 10 per second follows. The tape format is illustrated 
in Figure 6. 

d. Tape Capacity 

Each binary data word consumes 36 bits or 6 frames on the tape. 
At a recording density of 800 BPI, this is equivalent to 6/800 inches 
of tape per word. There are 9 words recorded at 100 per second and 
25 words at 10 per second, for a total of 1150 words per second, or 
1380 words in 1.2 seconds. At 460 words per record, there are about 
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TABLE V 



ORDER OF T-37 AIRCRAFT VARIABLES ON CALIBRATED TAPE 



Variable 


Units 


No. of Consecutive 
Samples In 1.2 Seconds 


1. 


Pitch 


Deg 


120 


2. 


Roll 


Deg 






3. 


Long. Stick Pos. 


Deg 






4. 


Lat. Stick Pos. 


Deg 






5. 


Rudder Position 


Deg 






6. 


Airspeed 


Knots 






7. 


Long. Stick Rate 


Deg/Sec 






8. 


Lat. Stick Rate 


Deg/Sec 




f 


9. 


Rudder Rate 


Deg/Sec 


120 


10. 


Thrust Attenuator 


Discrete 


12 


11. 


Roll Rate 


Deg/Sec 






12. 


Trim Tab Up 


Discrete 






13. 


Trim Tab Down 


Discrete 






14. 


Altitude 


Ft 






15. 


Heading 


Deg 






16. 


Yaw Rate 


Deg/Sec 






17. 


Acceleration 


g's 






18. 


Flap Position 


Percent 






19. 


Speed Brakes 


Discrete 






20. 


Landing Gear 


Discrete 






21 • 


Throttle Pos. (L) 


Deg 






22. 


Throttle Pos. (R) 


Deg 






23. 


RPM (L) 


Percent 






24. 


RPM (R) 


Percent 






25. 


Pitch Rate 


Deg/Sec 






26. 


Event Number 








27. 


Time 


Sec 






28. 


Roll -Computed 


Deg 






29. 


Vertical Velocity 


Ft/Sec 






30. 


Rate of Turn 


Deg/Sec 






31. 


Yaw 


Deg 






32. 


Pitch-Computed 


Deg 




t 


33. 


Time-Computed 


Sec 


12 
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3 rccords'per 1.2 seconds of data. Therefore, for each 1.2 seconds 
(3 records) of data, we require 
6 

(1380) + 3{IR6) = 10.35 + 2.25 ^ 12.6 inches of tape, 

800 

where IRG = 3/4 inches = length of inter-record gap. With 2350 feet ?f 
tape (standard reel, allowing for leader and trailer), it is possible to 
store 

12(2350) 

(1.2) = 2686 seconds 

12.6 

worth of data, or about 45 minutes. Normally, 'this resulted in two 
calibrated tapes per flight. 

e. Print-Out Format 

During the calibration run, an initial orint-out of the data at 
one, sample per second is produced. This print-out is used for quick 
checks of the system (i.e., verification of revised calibration iata, 
guarantee that total recording system is operating accurately, etc.) 
and preliminary measurement research. The data are printed in columns 
using three pages to represent 50 seconds of data. 

An illustration of the print-out format is provided in Appendix II. 
Recorded time is printed in the left-most column of all pages. Page 1 
(of every 3 pages) is used tc »sent all variables normally associated 
with movement about the lateral axis of the aircraft. Page 2 presents 
variables associated with movement about the longitudinal or vertical 
axes. Page 3 presents engine and discrete variables, the event 
number, computed time, and a record number. 

f. Calibration Software 

4 

The calibration programs are listed in Appendix III. A main 
program and seven subroutines were developed to (a) calibrate the data; 
(b) write the calibrated data on magnetic tape; and (c) print the 
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calibrated data at one sample per second. The program's approximate 
number of statements (including comments and data), and main function of 
each are as follows: 



PROGRAM 



LANGUAGE 



STATEMENTS 



FUNCTION 



Main 



Cyclex 
Calbrt 
Aitken 



Stores 



Fortran 



Fortran 
Fortran 
Fortran 



Fortran 



108 

60 ] 
Ul > 

19 



Control program 

Extract, ceLLibrate, 
and store data in 
100-word blocks 

Array-storage 



Selecx 



Fortran 



J 



54 



Arrays data for 
printout and calls 
print vhen page is 
full 



Prints 



Fortran 



40 



Prints data, l/sec 



Xtratc 



IOCS 



Units 



Map 

Map 
Map 



87 



171 



17 



> Tape handling 



Routines 



TOTAL: 



711 
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SECTION IV 
SAMPLING RATE STUDY 

• - * 

1. INTRODUCTION 

At the onset of this study, a decision had to be made regarding the 
in-flight sampling rate which would be adequate for purposes of 
performance measurement. Error in one direction would result in 
redundant data, contributing to the already difficult problem of data 
handling. Error in the opposite direction would result in a lack of 
sufficient data to accomplish the research. 

The popular existing approach to determining required sampling rates 
is to base the decision on sampling theory, which relates the worst case 
natural frequency of the aircraft to the sampling rate that effectively 
allows the entire "waveform" to be reproduced. This approach has been 
employed for years in the area of flight simulation. However, it is 
conceivable that such an approach would only guarantee the sufficiency, 
not the necessity, of the amount of data to be recorded. This is 
particularly true in light of the present intended use of the data, 
i.e., performance measurement of selected flight maneuvers. 

For lack of better guidelines, the sufficiency of 10 and 100 times- 
per-second sampling rates was intuitively assumed for launching the 
present study. An investigation of the necessity for such rates for 
those flight variables relevant to measurement on each flight maneuver 
is required, however, before specification of an optimal recording 
system can be made. In support of this, an initial sampling rate study 
was conducted, the primary purpose being to establish a methodology for 
sue 1 investigations. 
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1. APPROACH 

a. Discussion 

The, recorded data were sampled at a number of different sampling 
intervals (fe.g., every 0.05 seconds, every 0.01 seconds, etc.). For 
each test run, or each sampling interval used, tests were made to 
determine the errors that would result from generating the between- 
sampling-interval data from the sample-points using linear interpolation. 
In other words, the question addressed was, "If the only data available 
were those values sampled at an interval of n seconds, and intermediate 
data were then generated using those sampled values, what errors could be 
expected in the. generated data?" Figure 7 illustrates this concept. 




Tine 



Figure 7. Nature of Error Computation for Sampling Rate Study 
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As a test case for the study, pitch angle was exam^'ned during the 
performance of (a). 46 lazy 8 maneuvers and (b) 44 barrel roll maneuvers. 
Pitch was recorded in-flight at a sampling interval 0.01 seconds. 
Sampling intervals of 0.05, 0.10, 0.50, 1, 2, 3, 4, and 10 seconds were 
tested. An error distribution (histogram) for each maneuver and each 
sampling interval was then constructed. 

b. Software 

Appendix IV presents the FORTRAN program listings of routines 
used in the experiment. Portions of a typical print-out are presented 
in Figure 8. In Figure 8a, the first seven columns present (1) the 
event number (ENVO) of the maneuver; (2) sampling rate tested; (3) the 
total number of points comprising the maneuver as recorded on tape; 
(4) the "resolution" error (RES) tested, which was tfie tolerance within 
which an error was not counted and beyond which it was counted (RES set 
to zero for this application); (5) the number of times a tested point 
produced an error which exceeded RES; (6) the worst error (one with 
largest magnitude) encountered; and (7) the time into the maneuver 
(seconds) at which the worst error occurred. The remaining twelve 
columns present the number of errors whose absolute value lay in the 
range, indicated at the top of the respective column. 

Figure 8b summarizes the data in terms of fractional parts. The 3rd 
column presents the part of all samples tested in which any error was 
detected. Subsequent columns present the part of all samples-in-error 
in which error magnitudes fell in the indicated range. 

Since the two types of maneuvers to be examined were intermixed on 
several different tapes, it was most expedient to compU'.e the summary of 
all data by hand, following the several necessary computer runs. Each 
computer run produced results as shown in Figure 3 for all lazy 8*s and 
barrel rolls on one tape, plus additional compute' tions which aided the 
hand-summarization (by maneuver) of all data. 
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3. RESULTS 

Table VI summarizes the results obtained for the lazy 8 and barrel 
roll pitch-angle sampling rate study- The heavy line indicates the 
boundary which delineates the point in the error distribution where an 
asymptote is apparently reached. (The results must be interpreted in 
terms of this asymptote rather than solely in terms of the number of 
errors within certain bounds because of the existence of data spurs, or 
glitches. 

Table VI suggests that for the lazy 8, little would be gained using 
a sampling interval smaller than 1.0 seconds. Increasing the interval 
from 1.0 to 2.0 would effectively double the worst-case error. For the 
barrel roll, an interval smaller than 0.10 seconds would apparently be 
unnecessary. A slight increase in worst-case error would be experienced 
in a sampling- interval increase from 0.1 to 0.5 or 1.0. The real 
breakpoint occurs with intervals at 2 seconds or larger. 

It would appear, then, that, for pitch-angle, a sampling rate of 
1 per second for both maneuvers would be optimal, with slightly improved 
accuracy possible in the barrel roll by going to 10 per second. (Of 
course this investigation considered only a discrete set of test intervals, 
and a more thorough study may show a 5 or 7 per second rate optimal for 
the barrel roll.) If the pitch accuracy tolerance were +2** for both 
maneuvers, then a rate of 2 per second on the lazy 8 and 1 per second on 
the barrel roll would probably be required. 

This type of information is of some benefit both for specifying 
recording systems and for performing measurement analyses. Figures 9 
and 10 show how the data can be presented graphically to provide 
immediate indication of the adequacy of any proposed sampling rate for 
various error tolerances. Using Figure 9, for example, it is easy to 
discern the sampling intervals which would provide comparable results 
for, say, an error tolerance of +2"*. 
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TABLE VI 



FRACTIONAL PART OF PITCH ERRORS < x FOR 
VARIOUS Xl VALUES 

Error Magnitude (x) 





0.5 


1.0 


1.5 


2.0 


2.5 


3.0 


3.5 


4.0 


5.0 


10.0 


oc 
• Ub 


.960 


.988 


.991 
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.503 
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X represents the error magnitude. The table shows the fractional 
part (how many) of the total errors that were < x at each 
sampling interval tested. For example, at A = 1.0 (lazy 8), 
98.455 of the errors incurred were <1.0 in magnitude. 
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Figure 10. Sampling Interval Plot for Pitch (Barrel Roll, N= 44) 
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In addition to developing the type of data presented here, the 
sampling rate analysis could induce a matching of the error distribution 
to the portion of the maneuver being flown. For this purpose, maneuver- 
sections could be delineated using a Boolean Time Function approach, 
wherein necessary and sufficient conditions for each state or group of 
states of the aircraft, relating in turn to sections of the maneuver, 
are identified using logical operators (Reference 3). This could lead 
to an identification of the portions of the maneuver which, from a 
sampling-rate standppi^nt, load the requirements most heavily. These 
portions may or may not be critical in performance measurement and, 
hence, the sampling rate may be adjustable for a reduction of requirements. 
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SECTION V 

BASIC PERFORMANCE MEASUREMENT SYSTEM 

1 . GENERAL APPROACH 

The approach consisted of several distinct but interrelated tasks. 
Summarily, these tasks were: 

1. .Perform analysis of the maneuvers to be studied in detail. 

2. Develop theoretical measures based strictly on the results 
of the analyses. 

3. Compute the theoretical measures for representat.ve 
performances to determine which measures have! face-validity. 

4 Develop experimental measures consisting of (a) those 
theoretical measures which appear valid and (b) other measures derived 
through examination of the data. 

5 Compute the experimental measures for a broad sample of 
student and instructor data and perform analyses to validate the measures. 

The maneuver analyses were performed by Air Training Command. The 
analyses included (1) a maneuver dPS.ription. (2) an itemization of 
nianeuver elements, or separate portions of the maneuver, and (3) for 
each maneuver-element, the primary pilot tasks, the knowledge and skill 
required, and 'suggested error tolerances on critical parameters. 
Supplementing the information provided in the Primary Flying Manual 
(Reference 4). the task analyses provided a fair "picture" of each 
maneuver in addition to an indication of Air Training Copland standards 
of performance, insofar as it was possible at that time to quantify these 
■•andards. 

Theoretical measures were then developed based on the maneuver- ■ 
analyses. This was accomplished during the instrumentation/test flight 
phases of the study, so that quite early in the preliminary data- 
collection phase, measurement programs were available to enable data 
analysis and research to be initiated. 
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These preliminary measurement programs were applied to early 
performances of the Flight Test pilots. The resulting data- were 
analyzed to determine expected ranges of the critical flight parameters 
and evaluate the face validity of the various theoretical measures. 
Also, those portions cf the maneuvers and/or those pilot skills which 
seemed the most feasible candidates for automated measurement were 
identified* 

Final measurement programs were then developed for analysis of each 
student and instructor/pilot performance. These programs computed a 
variety of experimental measures believed to be relevant to performance 
evaluation. In addition, they produced automated plots of certain 
combinations of variables to produce a "picture" of the most relevant 
features of each performance. 

The remainder of this Section is devoted to a description of how 
each of the above tasks was accomplished and, where applicable, how 
measurement programs were implemented/ 

2. ATC MANEUVER ANALYSES 

a. Lazy 8 

(1) General Description 

The lazy 8 is a maneuver requiring simultaneous turning 
and climbing or descending so that e horizontal figure eight is described 
about a selected reference point located on the horizon. 

This analysis assumes that the aircraft is in the local flying area 
in level flight between maneuvers. 

Also assumed is that the student is in a po-.t-solo phase of the 
T-37, is able to control the aircraft in turns of specified bank angles, 
and to maintain straight and level flight. 
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For analysis purposes, the heading indicated on the compass should 
be used as a primary reference although the stydent will perform the 
maneuver using outside references. 

(2) Maneuver Elements 

Figure 11 illustrates the nine maneuver elements of the lazy 8. 
The element numbers coincide with the circled task analysis numbers 
(Table VII). 

(3) Maneuver Analysis 

Table VII presents the analysis of the lazy 8 as developed by 
Air Training Command. 

* 

b. Barrel Roll 

'1) General Description 

The barrel roll consists of an aerobatic roll maneuver of 
360'' bank about a selected reference point located ahead of the aircraft* 

The student must maintain a constant angle off a selected reference 
point through the 360** of bank with consta-'^ly changing pitch attitudes 
and airspeeds. 

Positive seat pressures must be maintained and roll rate must be 
constant. 

The student must cocrdinate rudder, elevator, and aileron deflection 
from nOiTnal . 

(2) Maneuver Elements 

The maneuver is divided into five segments (Figures 12a 
through 12e): 

1. Entry, which is not considered an integral part of the 
^naneuver, but is important for identifying the reference point and 
establishing maneuver orientation. 
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1 Haneuver entry 

2 45* turn point 

3 90* turn* point 

4 135* turn point 

5 180* tarn point (midpoint of maneuver) 

6 135* turn point (direction opposite from 0.1-0»^} 

7 90* turn point 

8 45* turn point 

9 Maneuver termination (straight and level flight) 



F'qure 11. Lazy 8 Maneuver Profile 
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2. First quarter roll (0 - 90^ roll) 

1. Second quarter roll (90 - 180'' roll) 

4. Third quarter roll (180 - 270"^ roll) 

5. Fourth quarter roll (270 - 360'' roll) 

(3) Maneuver Analysis 

Clearing the Area> This ensures visually that no other 
aircraft flight path would be in a position to conflict with maneuver 
area. It can be accomplished by a 180'* turn or two medium (40^*) to 
steep (60'^) banked turns in opposite directions of sufficient duration to 
visually clear the maneuver area. 

Selection of Reference Point. The reference point is usually an 
isolated cloud formation of small size or a section line stretching to 
horizon. The selected point must be easily identifiable and should 
contrast enough with surroundings so the student has no difficulty in 
keeping an eye on it. 

Entry to Barrel Roll, After selection of the reference point, the 
throttles are adjusted to 90%. The nose of the aircraft is then lowered 
below the reference point to attain an airspeed of 200 xo 230 knots. 
The aircraft is then rolled right or left with the aircraft continnng 
the descent until 20-30** to one side of the reference point. The wings 
are then rolled level to simultaneously allow the aircraft nose to come 
to level flight attitude. 

First Quarter of Roll. The student notes his angle off the reference 
point. This angle alpha (a) is between a line parallel to the 
longitudinal axis of the aircraft projected forward from the pilot and a 



line projected to the reference point. | This reference point should 
remdn in the same position on the windscreen throughout the maneuver 
regardless of airc»^aft attitude. A climbing- turn is executed toward 
the reference point to simultaneously reach 90^ of bank when the nose 
is alpha (a) degrees above the horizon. At this point, the 
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longitudinal axis of the aircraft should be in the vertical plane which 
passes through the reference point. Constancy of roll rate is the major 
difficulty in this task segment. Control deflection must be increased 
to compensate for decreasing airspeed. 

Second Quarter of Roll. The aircraft is rolled to an inverted level 
flight position (180** bank, 0^ pitch) to the angle a off the reference 
point. Although pitch attitude is decreasing, aircraft airspeed is 
continuing to decrease. Increased aileron deflection is therefore 
necessary to keep roll rate constant. Back pressure is still necessary 
during the initial portion of this maneuver segment to turn the aircraft 
to the propel angle off. As the aircraft approaches of bank, 
elevator control deflection is now decreased since lift on the wings is 
being exerted in the same direction as the force of gravity. 

Third Quarter of Rol l. The roll is continued f^-om wings-level 
inverted position to 90** of bank and a diving angle equal to angle a. 
At this 270** of roll point, the longitudinal axis of the aircraft is 
again in the vertical plane through the reference point. During the 
roll of 135** of bank, back pressure is nominal because lift is still 
being generated in a downward direction. As the 135^ roll point is 
reached, back pressure is slowly increased. Aileron deflection from 
the 180** roll point is decreased as airspeed begins to increase to keep 
roll rate constant. 

Fourth Quarter of Roll. The aircraft is now rolled from 270*" bank 
and diving attitude to the erect position. The reference point should 
again be equal to angle a. From the 270** bank point, aileron deflection 
will continue to decrease while back stick pressure will increase to 
decrease the dive angle. Roll out of bank and back pressure should be 
coordinated to properly come to level flight and angle a, simultaneously. 

* 
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(a) Performance Tolerances 

Following are estimates of realistic performance tolerances 
for some of the more relevant variables of this maneuver: 



Segment 
1 



"-5 

(4-quarters) 



Variable 

RPM p 
Entry lAS^ 3 
Minimum Altitude 
Offset of nose from 
reference point 

RPM 

g Force 

Angle off (alpha) 
between nose and 
reference point 



Tolerance 

90% +1% 
200-230 knots 
5000 ft AGL 
20** >< 60** 



90% +1% 

constant 1 >< 4g 
+10% 



(b) Significant Performance Factors 

Quantitative Factors: 
Variable 
1 . Airspeed 



Range 

100 to 260 knots 



2. Heading 



3. RPM 

4. Degree of Bank 

5. Angle Off (alpha) Error 

6. g Force 



Entry Heading, 20 to 60** off 
reference point 

90% +1% 

0 - 360** 
+10% 

1 < g <4 



Qualitative Factors: 

1. Smoothness in coordinated control movement 

2. Continuity of maneuver 

^It is. mandatory that at least 200 knots IAS be attained for entry. 
Maneuver will not be started or terminated below 5000 ft. 
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3. Quickness in discerning and applying the required control 
movements in various aircraft orientations ♦ 

4* Confidence and positiveness in controlling aircraft* 

c* Normal Landing 

Although detailed analysis in the study was limited to the lazy 8 
and barrel roll maneuvers, an analysis of the normal landing was also 
developed. Some preliminary work requisite to measurement research on 
the landing task has also been accomplished. The task analysis and 
preliminary follow-up analysis are documented below. 

(1) General Description 

A circular approach to the active runway consisting of: 

1. An initial approach to the active runway 1000 ft AGL 
(above ground level) 

2. A level 180° turn with simultaneous reduction of airspeed 
to a downwind ppsition 

3. Speed brake, landing gear, and flap lowering 

4. A descending 180*' turn to align with the active runway 

5. A glide path to the touchdown point ii the first 1000 ft 
of the runway. 

This analysis assumes the student is in early stages of aircraft 
pheckout through termination of T-37 flying. 

Also assumed is that the student is capable of level flight, turnin.i 
level flight with airspeed changes, and descending turns while maintaining 
airspeed. 
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Displacement from runway (ground track) cannot be taken from aircraft 
^instrumentation and would necessarily be a result of 'instructor verbal 
input. 

(2) Maneuver Elements 

Figure 13 illustrates the six maneuver elements of the normal 

landing. 

(3) Maneuver Analysis 

Table VIII presents the task analysis of the normal landing 
as developed by Air Tra'^ning Command. 

(4) Extended Analysis of Noiinal Landing 

By utilizing the maneuver analysis, information in the primary 
flight manual (Reference 4), and personal knowledge of the normal landing 
task, we developed an extended analysis of the task. This was 
accomplished as a first step in (a) properly segmenting the maneuver 
for measurement purposes and (b) identifying basic ATC criteria as 
they apply to various segments of the task. The results are presented 
in Appendix V. 

3. THEORETICAL MEASURES 

Theoretical measures were developed using maneuver-analysis data for 
t»9 lazy 8 and barrel roll maneuvers. These measures constituted a ^ 
"first guess" at an appropriate set of measures and were based solely 
upon ATC criteria. Their computation was accomplished through the 
development of appropriate software, which was then used to compute the 
theoretical measures for a sample of flight test pilot performances. 
The following paragraphs are devoted to a description of the -theoretical 
measures and the rationale underlying their development, the implementation 
of software for their computation* and initial tests. 



Instrumentation, for this study, did not include a means of determining 
ground track. 
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Figure 13. Normal Landing Maneuver Profile 
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a. "Description 

(1) Lazy 8 ; - . 

As suggested by ATC, the primary reference variable in this ~ 
maneuver (for purposes of developing theoretical measures) y^as aircraft 
heading. Criteria for most other variables were functions of heading. 
The criterion for heading itself was computed as a function of the initial 
sheading selected by the pilot upon entering the maneuver. 

^ ' • 

The lazy 8_ is a maneuver consisting of two syjiin parts. 
-Therefore, cHteria S^nd initial; ineasy^^ were developed only 

for the first half of the maneuver, but were applicable to the second 
Hatf as well. Theoretically, we may regard the lazy 8 as two 
successive performances of a "half lazy 8," both done in opposite 
directions and with smooth transition and no hesitation between 
performances. 

Figure 14 and Table IX together sketch the maneuver and the 
performance criteria suggested by ATG in their maneuver , analysis. 
This information was used in developing mathematical expressions for 
the criteria and tolerances for bank, pitch, vertical velocity, airspeed, 
altitude, g's, and RPM. Then measures were developed based on a 
comparison of recorded data with criteria and, where applicable, with 
tolerances. p 

The following discussion presents, first, the individual 
theoretical measures (denoted S.) developed for each aircraft variable. 
These S. measures indicate how much the performance differed from ATC 
criteria, and where applicable, tolerances. 

Next, combined theoretical measures are described. These consist 
of linear combinations of selected S. measures to provide a single 
measure for each of several aspects of the performance. One 
combination measure, for instance, reflects how well the pilot's 
transition from descent to level flight at the 180" turn point is 
synchronized with the transition to zero bank angle. 
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Finally, a "total score" is developed from the combination measures 
to provide a single indicant of total performance* this is a weighted 
sum of the combination measures, with the weights consisting of "best 
guesses" for this theoretical measures development, 

(a) Bank Angle 

To express mathematically the criteria and tolerances 
relevant tp bank angle, linear relationships have been established 
between Bank (B) and Turn (T) from the information in Table IX, 

When turn is 15°, bank should be 13 - 15°; when turn is 30°, bank 
should be 27 - 30°, etc. Since it is desirable to have a continuous 
bank criterion, .and not just a check at discrete turn-points, a function 
relating bank to turn would'be preferable* This also simplifies 
programming (easier to code one function than to do table look-ups ,and 
interpolation). The functions: 

Bank = Turn or B = T 

8 8 
and Bank =-g- Turn or B « |* T - 

approximately represent the upper and lower bounds for bank angle for 
all points of turn from 0 to 90°. Therefore, the criterion for this 
region is: 

f T < B < T 

The tolerance for bank, as provided in Table IX, is +4°. Therefore 
(T + 4) and T - 4) represent the upper and lower tolerances. 
Similar analysis was performed for 90 to 180° turn region and the 
following mathematical expressions for criteria and tolerances were 
derived: 

For 0° < T < 90°: 

|t-4<{|t<B<t}<T + 4 (1) 
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For 90** < T < 180»: ^ 

f (175.5 - T) < [I (180 - T) < B < 180 - t} < 184 - T (2) 

where T = the degrees of turn made "(i .e. , degrees of heading-change) 
and B = the angle of bank. 

In inequalities (1) and (2) above, the most extreme quantities 
represent tolerance limits, while the criteria themselves are represented 
by the portions of the inequalities within brackets. 

The measures desired for bank angle should reflect (1) whether or 
not, and to what extent, the basic criteria are satisified, and 
(2) whether or not, and to what extent^ the tolerances are exceeded* 
Separate measures are desired for each of these considerations, because 
different weights may be required in performance evaluations depending 
upon whether criteria are not satisfied, but tolerances are; or whether 
neither is satisfied. 

Let^ 



B. - 

It, 



Tj , < 90 , AND Bj > T| 



8 



B, , Tj < 90 , AND B. < Tj 
Bj - 180 + Tj , Tj > 90, AND Bj > 180 - Tj 

•|(l80-Tj) - Bj , Tj > 90, AND Bj < |- (180 -Tj) 
^0 , otherwise 



where the subscript i refers to the value of the variable at the i^^ 
sampling instant. 




is interpreted as follows: X = Y if L is true and X = Z if 
K is true. 
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Let 



B| - T,, - 4 , T, < 90, AND Bj > T, +4 



i 'i 



f T, - 4 - B, , t, < 90 , AND B, < f- T, -4 ■ 

N, = ^B, - 184 + T, , T, > 90, AND B, > 184 - T, 

1^(175.5 -Tj) - B, , T, > 90, AND B, < f (175.5 -T,) 
0 , otherwise 



The values M.j and respectively provide the amount by which criteria 
are exceeded and the amount by which tolerances are exceeded. Integrating 
each of these, we obtain: 



S, = J*M, dT 



0 ' 



dT 



Si is an integrated error measure showing the extent to which bank 
criteria are exceeded; Sy similarly, shows the extent to which bank 
tolerances are exceeded. 



(b) Pitch Angle 

The required pitch angle has been established by ATC as a 
function of the maximum pitch angle attained in the maneuver (Table IX). 
Call this maximum pitch angle H. As indicated in Table IX, pitch should 
reach its maximum (H) at the 45^ turn point, should then decrease to 
zero by the 90^ turn point, should reach its negative maximum (-H) at 
the 135"* turn point, and should then return to zero again at the 180?- 
turn point. The change in pitch should be a linear function of the 
degree of turn. 
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The following criterion inequalities were computed from the 
information in Table IX. As in the case of bank angle, the portions of 
the inequalities within brackets represents the basic criteria, whereas 
"^the portions 'outside the brackets represent tolerances. 

Let P = Pitch Angle * 
and T = Degrees of Turn: 
For 0° < T <'45°: 



0-9HT < f_HT - p i < I.I HI 

45 ~ 145 J ~ 45 . 

For 45° < T < 90°: 

0.9H(90-T) < f H(90-T) . pV < |.IH(90-T) 

45 - I 45 ■ '■^J - 45 

For 90° < T < 135°: 

I.IH (90-T) < f H(90-T) _ pi < 0.9H(90-T) 

45 "I 45 ~ ~ 45 

For 135° < T < 180°: 

'•IH(T-I80) < f H(t-I80) _ pV < 0.9H (T-180) 

45 - I 45 " - 45 

The performance measures desired should reflect the deviation from the 

criteria plus any deviation outsi,de the tolerance limits. 
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Let 



P _ HT 
45 



T < 45 AND 

0.9HT 



45 



< P < 



MHT 
45 



p_ H(90-T) I 45 <T < 30 AND 



O.^H + JIz4^1^±0JLHl < p < , ^ (T-45)(5H.IH) 
H(90-T) 



P 45 I . 90 < T < 135 AND 



(T-90)(0.9H^-5) 3 , p ^ (T-90)(IJH^5) 

45 3SP< ^ +5 



p^ Jill^l^ T > 135 AND 



(T- l35)(3-f 0.9H) (T-I35){3-I IH) 
^45 :-+0.9H<P^ -LLJ22^J5_JiHL^.,,„ 



For each sampling instant, i, the 'm^ above reflects the absolute value 
of the difference between the actual and criterion pitch angles whenever 
tolerances are not exceeded. 
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Let 



P - -4r- • T < 45 AND P > ^ 

5:?^ - P . T 45 AND P < 0'.^»1 

p _ MH 1|P-T) , 45 < T £ 90 AND 

p ^ I.IH (90-T) 
45 

°'"!,y-^' -P ^ 4S<T 4 90 AND 

p < 0.9H(90-T) 
45 

P- 90< T 5135 AND 

p > I.IH (90-T) 
45 
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and 

0.»H(»0-Tl .p ^ J 

p < 0.9 H (90-7) 
45 

P- .,T>.3» AND 

p > i.iH(T-ieo) 

45 

Q'^"<V,"Q^ - P . T > 135 AND 

p< o.9Hn-ieo) 

45 

For each sampling instant, i, the above reflects the amount by which 
tolerances are exceeded. Integrating, we obtain the following measures 

J 

S, « /'m, dT 

0 

J 

$4 « J\ dT. 

0 

-^3 JS^J/^ are integrated error measures showing" the extent to which ■ 
pitch criteria and tolerances, respectively, are excee ded. 

(c) Vertical Velocity 

Basefi on the information in Table IX, vertical velocity (V/V) 
should be zero at the 0**, 90**, and 180** turn points. Further, V/V 
should be positive from T = 0** to T = 90** and negative from T = 90** to 
T = 180**. There is no tolerance for error. 



•n,. 
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Let = V/V when turn = 0° 
Rg = V/V when turn 90 • 
R3 = V/V when turn =180° 

Then one measure may be computed as; 

S, = |R, I + [Ral + IR5I 

TMs gives us the sum of absolute vertical velocity errors at the 0°. 
90", and 180° turn points. 

Let 



|V/V|,0 < T < 90 AND y/V < 0 



V/V, 90 < T < 180 AND V/V > 0 



0, otNtwit* 



Then 



Where tinio is number of 
seconds for that half of 
the maneuver. 



This gives the integral error on the V/V direction frcm T = 0° to T " 180°. 

One other aspect of V/V needs to be checked. The V/V should become 
zero at the 180° turn point at the same time that the angle of bank 
becomes zero. Neither should occur before the other. 



Let T^ = the time at which V/V first becomes zero when 135° < T < 180° 

and Tg = the time at which bank first becomi?s zero when 135° < T < 180°. 

If either V/V or bank does not become zero withrin the period designated, 
set T. (i = 1 or 2) to 0. 
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Compute 



St = 



\^\ ^ ""al , T, # 0 AND # 



, T, = 0 OR = 0 



tells- tis the elapsed time, in seconds » between points where V/V and 
bank become zero. If S y is -lathis means the quantity was unmeasurable. 



(d) Airspeed 

Airspeed should be 200 knots on entry, i.e., at the 0^ turn 
point, with a tolerance of +3 krauts. At the 90^ and 180**, turn ^points, 
airspeed should be 100 and 200 knots respectively, with a tolerance of 
+5 knots. At all other points in the maneuver, airspeed must be more 
than 100 knots, and. less than 200 knots. 



Let 



A -200 , A > 200 AND 2 < T < 178 



lOO-A , A < 100 AND 2 < T < 178 



0 , ofhtrwisft 



where A = airspeed in knots. 
Then compute 



MM| dT 
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Sq is an integrated error measure showing^ how much the airspeed criteria 
are exceeded from 2 to 178° of turn> It checks for deviation below 
100 knots or above 200 knots. 

To check airspeed at the 0, 90, and 180** turn points, we will compute: 

S, = |Ao - 200| 

S„ = |A„o- 200| 

where Aj^ = airspeed at T = 
(e) Altitude 

The main requirement on altitude is that the maximum altitude 
attained in the maneuver (ALTj^j^) should occur at the 90** turn point* 
We can further hypothesize that altitude should be the same at the 0^ 
turn point as it is at the 180** turn point and the same at the 90** turn 
point as it is at the 270° turn point, because this is a symmetrical 
maneuver* Further, altitude should be monotonically increasing* from 
T = 0*" to T = 90° and monotonically decreasing from T = 90** to T = 180*** 

First, a measure is needed to check that the maximum altitude is 
attained at the 90** turn point* Also, if ALTj^j^ is not attained at the 
90° turn point, we should record (1) where ALT^^jj is attained and 
(2) how much ALTj^^j^ differs from the altitude attained at 90*** In 
monitoring altitude it will be necessary to check the entire maneuver 
from start to completion rather than to check one^half independent of 
the other half. 

Let AA^ = maximum altitude obtained from T = 0** to T = 360°* 
Let ALTj^ = Altitude obtained at T = 

TT^ = Degrees of turn when AA, occurs. 
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Compute 
h3 



I ALTi8o - ALTq 



How much does altitude at turn = 180° differ 
from starting altitude? 



ALT,^n - ALTn | How much does altitude at turn = 360° differ 
"^^^ " • from starting altitude? 

= I ALTon - ALT,,^ j .How much does altitude at turn = 90° differ 
' ^" ' from altitude at turn = 270^ 



'15 



AA^ - ALT 



'16 



= |n,- 



90 



j Hoy/ much does MAX altitude differ from 
altitude at turn =90°? 

j How far off was the pilot from 90° when 
* MAX altitude-occurred? 



(f) Acceleration (g Force) 

The main requirement on g force is that it be between 1 and 
2 g*s at the start (T = 0) and end (T = 360) of the maneuver. 



Let 



G - 2,G>2 at T=K 
I - G,G<I atT=K 
0 , otherwise dt T = K 



Then compute 



S|7 = ^0 



5ie • ®3eo 



This gives us absolute deviations outside criteria for g's at the start 
and end of the maneuver.- 



(g) RPM 

RPM must be 90% throughout the maneuver. A tolerance of 
+1% is specified. 
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Let 



AM. - 



RPM, - 92 , RPM; > 92 



88 - RPM. , RPM. < 88 



0 , otherwise 



Compute 



AM. dT 



S-jg is an integrate d error measure showing how much the RPM tolerances 
were exceeded over the maneuver. 

Table X presents a summary of the above measures S-, - (See Table 
XI for a definition of terms u$ed in the summary table). 



Figure 15 is a maneuver diagram for the lazy 8 showing which portions 
of the maneuver are checked by each experimental performance measure. 
Continuous measures, as depicted in Figure 15, are ones which monitor one 
or more performance variables continuously for a discrete time interval. 
Discrete measures monitor certain performance variables -it selected 
discrete points in the maneuver. 



(h) Combined Theoretical Measures 

For experimental purposes, the following scaled measures and 
combinations ther of we're computed and printed, in addition to the 
individual S^. measures. The assigned weights are based on the authors' 
judgment as to measure-criticality. The scaling is based on the 
expected ranges ip Table X and is designed to produce combined measures 
that range from 0 to 100 to standardize the measures. For example, 

and $2 are the individual theoretical measures pertaining to degree 
of bank. Their expected ranges are, for each, 0 to 3000 (See Table X). 
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TABLE XI 

DEFINITIONS OF TERMS USED IN TABLE X 



T 


= degree of turn since start of maneuver 


B 


= angle of bank 


"i 


= amount by. which bank-angle criteria are exceeded 




= amount by which bank-angle tolerances are exceeded 


\ 


= absolute value of the difference between actual and 

\J 1 UL>n uiiy 1 cb 


1 

\ 


= amount by which pitch angle tolerances are exceeded 




= V/V when T = 0^ 




= ^ V/V when T = 90^ 




= V/V when T = 180° 




= errOi in direction of Vertical Velocity 


^1 


= time when V/V becomes zero at 135° < T £ 180° 


^2 


- time when bank becomes zero at 135° < T £ 180° 


A 


= airspeed 




= absolute value of airspeed error at 2° < T < 178° 


\ 


= airspeed at T = K 


AA^ 


= maximum altitude obtained at 0 < T < 360° 




= turn when AA^ occurs 


ALT, 


= altitude at T = K 




= absolute value of g force at T = K 


AM. 


= RPM error at '*th sampling instant 
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The weights assigned to them are 1 for (which tells how much criteria 
are exceeded) and 3 for (which tells how much tolerances are 
exceeded)* Therefore + SSg is a linear weighted combination of Sj 
and Sg. Since both are expected to range from 0 to 3000, (S^ + 3S2) 
could range from 0 to 12,000* By dividing + 3S2 by 120, the range 
would be from 0 to 100; e*g*, 

0 < ' ~ < 100 

120 

Since this is an error-measure (the higher the value the worse, 
theoretically at least, the performance), we can convert it to a score 
by substracting it from 100; e.g., 

0 < 100 - • ^ < 100 

' 120 

The combined theoretical measures, each derived as explained above, are 
presented below for each of several measurable characteristics of 
performance. They are referred to as "scores" because of the scaling 
applied, but essentially they are measures of performance computed by 
combining various individual theoretical measures. 

Degree-of-Bank Score (DBS), Measure of how well the pilot's bank 
angle compares with ATC criteria as a function of degrees of turn. 
(Separate measure for each half of maneuver.) 

S| -f 3S- 
DBS - 100 • ^ 



120 

Pitch Angle Score (PAS). Measure of how well the pilot's pitch 
angle compares with ATC criteria as a function of degrees of turn. 
(Separate measures for each half of maneuver.) 

S, ^ 3S4 
PAS = I00-- ^ ^ 



120 
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Vertical Velocity Score 1 (VVSl), Measure of how well the pilot's 
transitions from climb to descent,. and the reverse, are synchronized 
with the 0, 90, and 180*' turn points. (Separate measures for each half 
of maneuver.) 

VVSl = 100 ^ ^ 

225 

Vertical Velocity Score 2 (VVS2). Measure of how well the pilot's 
transition from descent to level flight (momentarily) at the ISO*' turn 
point is synchronized with his transition to a zero bank angle. (Separate 
measures for each half of maneuver.) 

VVS2 = 100 - 5,8 Sj 

Airspeed Score (ASS). Measure of how well the pilot's airspeed 
at the 0, '90,^ and 180° turn points compares with ATC criteria, and how 
well his airspeed throughout the maneuver remains within the bounds 
specified by ATC. (Separate measures for each half of maneuver.) 

Sm + 4{So + S.n + S,,\ 

ASS = 100 = ^-2 !fi iiL 

8 

Altitude Score 1 (ASl). Measure of the symmetry of the pilot's 
performance of the maneuver as judged by comparing his altitudes at the 
0 and 180*' turn points, the 0 and 360° turn points, and the 90 and 270*' 
turn points. (One measure for entire maneuver.) 

ASl = 100 ^i? 

36 

Altitude Score 2 (AS2). Measure comparing the maximum altitude in 
the entire maneuver with the altitude attained at the 90*' turn point; , 
and comparing the degrees of turn achieved when the highest altitude 
was attained with 90*'. (Separate measures for each half of maneuver.) 

AS2 = 100 - ,t 

14.7 
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9 force Score (GrS). Measure of how well pilot's g force at start 
and end of maneuver remained within bounds specified by ATC. (One 
measure for'entire maneuver.) 

6FS = 100 - 5.S (S,7 ♦ S„) 

RPM Score (RPMS). Measure of how well- pilot maintains the required 
RPM on both engines throughout the maneuver. (Separate measures for 
each half of maneuver.) 

RPMS = 100 - 0;5? S,, 

Total Score. Measure how well all of the criteria are satisfied. 
SCORE = —« [7 ((DBS) ♦ (PAS)) ♦ 6(AS1) 
5(AS2) 4(VVS1 ♦ VVS2*) 3(ASS) 

2 (RPMS) ♦ GFsjdOO) 

VVS2 , VVS2 S 100 
0 , VVS2 > 100 
3900 ,VVS2 < 100 

ond TOT " s <| 

[ 3500 , VVS2 > 100 

Miscellaneous Data 

1. Time to complete maneuver 

2. Maximum and minimum pitch angles in each half of maneuver 

3. Maximum altitude and corresponding T 

4. Number of data samples in each half of maneuver 

5. Number of inflections in the roll and pitch curves 

6. The measures averages over the entire maneuver. 



wh«rt VVS2* * 
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(2) Barrel Roll 

In a manner similar to that for the lazy 8, individual 
theoretical measures for the barrel roll will be described first, treating 
each of the following measurement variables independently: attitude, 
RPM, airspeed, g's, and roll rate. Following the iiidividual measures, 
combined measures will be described. 

(a)_ Attitude 

Possibly the most pertinent performance measure for this 
maneuver is one reflecting the pilot's skill in attitude control, i.e., 
skill in maintaining a constant angle, 9 , between the pilot's, line of 
sight to the selected reference point and the pilot's line of sight 
projected forward and parallel to the longitudinal axis of the aircraft. 
This angle must remain constant throughout 360° of continuous roll, the 
suggested error tolerance being +10%. 

The major difficulty of measuring this aspect of the performance is 
that no method exists, on the basis of the recorded flight data, for 
determining the location of the selected reference point. Therefore, 
the criterion angle, 6 , and the criterion flight path are both nebulous. 

Three approaches were developed for measuring this part of the 
performance. One involves computing two projected criterion flight 
paths on the bases of certain key measures taken at various points during 
the maneuver. Measures based upon each projected criterion flight pat), 
are made. The second approach involves taking a number of measures 
throughout the maneuver which check the symmetry of the flight path. 
The third approach involves computing a projected criterion flight path 
based upon a type of "best fit" of a correctly shaped flight path to the 
observed flight path. These three approaches are described below. 

Attitude Measure A. This measure begins with the computation of 
two projected criterion flight paths, each of which is based on the 
assumption that two of the pilot's actual attitudes are correct. 
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Let = the pilot's initial heading 

H2 = the heading attained during the maneuver which differs most, 
in absolute value, from 

and = the pilot's largest positive pitch angle. 

It is hypothesized that in the perfect maneuver, a plot of heading 
versus pitch angle, suitably scaled, should result in a perfect circle. 
What we do not know abouv this criterion circle is its size, although 
we know it must pass throigh the point (H^, 0), j.e., the starting 
position for heading and pitch angle. 

To construct a projected criterion circle, we may use the starting 
position and one other position. For one criterion circle, we select 

and Hg. This assumes that the pilot's heading is correct at 
(1) the start of the maneuver and (2) the end of the second quarter 
of the maneuver. The criterion circle would thus have its center 
heading at 

C, = -J- ([H|+ Hjj] mod 36o) 
and would have a radius of 



|H,- C, I . I H, -C, I < 180 

|360 -H, + C, , I H, - C, I > 180 

Let X. = sampled heading at T = i 

= sampled pitch angle at T = i 

Then the criterion circle is 

(Xj - C,)2 + c nf (3) 

Now, to construct a second (alternative) projected criterion circle, we 
may use the starting position, and the pilot's largest positive pitch 
angle, P^. This assumes that (1) the pilot's heading is correct at 
the start of the maneuver, and (2) the pilot's pitch is correct at ihe 
end of the first quarter of the maneuver. 
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This criterion circle would have its center heading at = B, where 
B is the heading held when is recorded. The radius of the circle 
would be = P^. 

Then the second criterion circle is 



The measure we want is the variance of the actual flight path from 
each of the alternative criterion circles: 



Attitude Measure B. This attitude measure checks the symmetry of 
the performed maneuver. First we define the following: 

= initial heading 

= heading when bank first becomes 90'' 

= heading when bank becomes 180'' 

= heading when bank becomes 270'' 
Hg = heading when bank returns to O'' 
P^ = initial pitch angle 

= pitch angle when bank becomes 90" 
Pj = pitch angle when bank becomes 180'' 
P^ = pitch angle when bank becomes 270" 
Pg = pitch angle when bank returns to 0" 



(X, - C^)^ ^ - R^^ 



(4) 




(5) 




(6) 
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For perfect symmetry in the maneuver, the following should hold: 
1 . I - I MOD 360 = | H3 - Hg | MOD 360 



2. H^=H5 

3. ^2 = 

4. P^=P3=P5=0 
5- 1^21 = |''4l 

6. 20° ^ I "2 ' "1 I 360 < 30° 

7. P2 > V P3 V V P5 

8. P4 < Pi VP2VP3VP5 

9. ALT when is obtained = ALT when H3 is attained 
10. I ALT when is obtained - MAX ALT | 

= I ALT when is obtained - MIN ALT | 

The specific measures to be taken to reflect the degree to which the 
above criteria are met are given below: 

1 . S3 = I I - I MOD 360 " .| H3 - | MOD 360 | 
(Checks heading synwietry for half of maneuver.) 

2. = I - Hg I MOD 360 

(Checks heading equality at start and end of maneuver.) 

3. Sg = I - H^l MOD 360 

(Checks heading symmetry at 90° and 270° Roll points.) 

(Checks that Pitch = 0 when it should.) 
(Checks for pitch symmetry. ) 



6. Sq = 



0, 20° 1 |"2 " "1 I 360 ^ 30° 
I I Hg - I MOD 360 - 20 I , | Hg - | MOD 360 < 20' 

I I - I MOD 360 - 30 I , | - | MOD 360 > 30' 
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(Checks that reference po.int is^ initiany 20 to 30° off the 
longitudinal axis of the aircraft.) 

7. Sg = I MAX (P.) - I (i = 1 , 3, 4, 5 if MAX > P^; else 0) 

(Checks that MAX Pitch is achieved at Roll = 90°.) 

^' ^10 " I ^n'^^^^i I (i = U 2, 3, 5.if MIN < P^; else 0) 

(Checks that MIN Pitch is achieved at Roll = 270°.) 

9. S^^ = I ALTg - ALT,j | where ALT^ = ALT at 

and ALT. = ALT at 

b 3 

(Checks for altitude symmetry.) 
10. S^2= ||ALT^-Aa I - |ALT.-ALTj| 

Where ALT^ = MAX ALT 

and ALT^ = MIN ALT 
(Check for altitude synafnetry,) 

Attitude Measure C, This attitude measure involves computing a 
projected criterion flight path based upon a type of "best fit'^'V a 
correctly shaped flight path to the observed flight path. The major 
assumption is that the starting point for the maneuver is accurate. 
This IS reasonable, since the pilot selects his own starting point in 
relation to his-reference point, or vice versa. Surely, the true 
criterion flight path is a circle passing through the starting point H^. 
Furthermore," a diameter of the circle passes through and is parallel 
to the earth. Figure 16 illustrates some of the possible criterion 
flight paths based on this information alone. The idea here is to 
compute a single criterion flight path, and the method selected for so 
doing is to minimize the integral error between the observed fligh path 
and the criterion. Figure 17 illustrates several hypothetical observed 
flight paths and the approximate criterion flight path that would be 
computed in each case. 
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Computed criterion path 
Actuol path 



Figure 17. Criterion vs Actual Flight Paths for Barrel Roll 
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Let X^. = observed heading at T = i 
Y^. = observed pitch angle at T = i 
= heading at start of maneuver 
and R = radius of the criterion circle. 

Then the equation of the criterion circle is: 

(x. -[h, ± r]) +Y.^ = r2 . (7) 

where R is unknown at the present and the + or - sign in the first term 
is determined by whether the barrel roll is performed to the right (+) or 
to the left (-). (In computing +R, appropriate modifications would 
need to be made if a crossing of 0° heading occurs, i.e., use modulo 
360°.) Now we shall expand the terms in Equation 7 and solve for R in 
terms of X^. , Y . , and : 

Xf + [h, ± r]^ - 2 X. [h, ± r] + = r2 

X,^ + Hf + R^ ± 2 H, R - 2 H, X, ? 2 X, R + Y,^ - R^ = 0 

± 2H, R ? 2X, R s 2H, X, - Xf - H,^ - Y* (8) 

^ ^ 2H, X; - X,^ - H.^ -Y,^ 

2(±H, h;x,) 



Now the integral equation we wish to minimize in order to arrive at a 
value for R is 

/.T 2 H, X, - Xf - Hf - Y,* , 

/ R LJ_^ L L 

• 2(±H, ?X,) 
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To do this, we select 



p - -L f 2H, X|- Xf -H,^ -Yf 
n 



\zt 2 (± H, ? Xj) 

The measure desired is the variance of the actual flight path from the 
criterion circle, now fully determined by the derivation of R: 



(9) 



S|3 =/ - [h, ± R]f - Y,2 I dT 



This is an integrated error measure of the deviation between criterion 
and actual flight paths, as determined by roll and heading angles. 



(b) RPM 

RPM must be maintained at 90% (+1%) throughout the maneuver. 
A straightforward measure may be taken: 



Let 



|rPM, - 90 I , I RPM, - 90 I a I 

0 , I RPM, - 90 I < I 

where RPM^. is the actual value of RPM at T = i. 



Then the RMS error is 



where n is the number of samples taken in which M^. ^0. 

This measures the average RPM error when tolerances are exceeded. 

(c) Airspeed 

No definite restrictions are placed upon airspeed except 
during entry to the maneuver. On entry, airspeed must be at least 
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200 knots and should not exceed 230 knots. Straightforward measures 
may be taken as follows: 

Let and represent the times at which entry to the maneuver is 
begun and completed, respectively. Let 



M, - MAX IaIRSR - 200 I 

M, - MAX IaIRSP. - 230 | 
i<5<n • 



Then compute 



»I5 



0 , AlKSFj > 200 
M, , AIRSPj < 200 



Entry oifspMd dtvlotlon 
under 200 knots. 



0 , AIRSFj < 230 Entry oirtpMd dtvtotton 

ovtr 230 knots. 
Mj , AIRSPj > 230 



(d) g Force 

.g-force is to be maintained at 1 < G < 4 throughout the 
maneuver. The measure we shall take will reflect the integrated error 
on g when it exceeds the bounds, i.e., when 6 < 1 or G > 4. 



S 



Whtrt 0« 



0 . I !S 6 < 4 
6 -4 , 6 > 4 

I -6 , 6 < I 
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(e) Ron Rate 

Ron rate is to be held constant throughout the maneuver* 
A measure of constancy may be obtained by differentiating Ron Rate (RR) 
with respect to time. Thus, we shan compute 

^ of roll roti. 

(Note that the absolute value of the derivative is used to avoid tenn- 
canceningO 



Table XII presents a surmiary of the measures through S^g (See 
Table XIII for a definition of terms used in the summary table*) 

(f) Combined Theoretical Measures . 

Figure 18 is a maneuver diagram for the barrel roll with 
indications of the portions of the maneuver checked by each experimental 
performance measure* The "continuous measures" indicated in Figure 18 
are ones which monitor one or more performance variables every sampling 
instant over a discrete time interval* Other measures monitor 
performance variables at several discrete positions during the maneuver* 

For experimental purposes, the following scaled measures and 
combinations thereof were computed and printed in addition to the 
individual S. measures* As described in the section on the lazy 8, the 
weights were determined by the authors based on the judged criticality 
of individual measures; and scaling was performed to produce combined 
measures ranging from 0 to 100* 

' Entry Airspeed Score (EAS)* Measure of how well the pilot holds 
the correct entry airspeed to the maneuver* Failure to hold at least 
200 knots is weighted more heavily than failure to remain below 
230 knots* 

EAS = 100 i5 L5« 
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TABLE XIII 



DEFINITIONS OF TERMS USED IN TABLE XII 



ALTg 

ALT, 
ALT^ 



radius of computed criterion circle No. 1 
sampled heading at T = i 

center heading of computed criterion circle No. 1 
sampled pitch at T = i 
radius of computed criterion circle No. 2 
center heading of computed criterion circle No. 2 
initial heading 
heading when bank becomes 90*^ 
heading when bank becomes 180® 
heading when bank becoiries 270** 
heading when bank returns to 0** 
initial pitch angle 
pitch angle when bank becomes 90'' 
pitch angle when bank becomes 180® 
pitch angle when bank becomes 270® 
pitch angle v:hen bank returns to 0® 
altitude when is obtained 
altitude when is obtained 
maximum altitude obtained 
minimum altitude obtained 
radius of computed criterion circle No. 3 
RPM. - 90 . I RPM. - 90 I ^ I 



1 
0 



, I RPM. - 90 I < I 



MAX j AIRSP. - 200 | 
i<l<n ^ 



ERIC 
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TABLE XIII (Concluded) 
DEFINITION OF TERMS USED IN TABLE XII 



M, = MAX I AIRSP, - 230 | 

(0 , 1 < G < 4 1 
G - 4 . G > 4 [ 
1 - G , G < 1 .J 

RR| = roll rate at ith sampling instant 



ERIC 
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Attitude Sc ore 1 (ASl). Measure of how we'll, the pilot's flight 
path compares with^a criterion flight path based on the assumption 
that the pilot's attitude and position are optimum at the start of the 
maneuver and at the end of the second quarter. 

ASl - 100 - -=;ir. 

300 

Attitude Score 2 (A$2). Measure of how well the pilot's flight 
path compares with a criterion flight path based on the assumption that 
the pilot's attitude and position are optimum at the start of the 
maneuver and the end of the first quarter. 

A82 . 100 - ^ 

Attitude Score 3 [Heading] (AS3H). Measure of the symmetry of 
the pilot's performance of the maneuver as judged by aircraft heading 
at various points. This includes checks on (a) comparison of 
heading change over first and second quarters; (b) comparison of 
headings at start and end of maneuver; (c) comparison of headings at 
"top" and "bottom" of maneuver; and (d) the pilot's reference angle 
to the chosen reference point. 

AS3H . 100 - 28,^ S. 

4.5 

Attitude Score 3 Pitch (AS3P). Measure of the symmetry of the 
pilot's performance of the maneuver as judged by aircraft pitch angle 
at various points. This includes checks on (a) zero pitch at 0. 
180. and 360" roll points; (b) comparison of pitch magnitudes at 
"top" and "bottom" of maneuver; (c) whether maximum and minimum pitch 
angles are attained at the 90 and 270° roll points, respectively. 

A83P . 100 - ^^T^ 2S, ^ 2 3.. ^ 8. 

5.1 
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Attitude Score 3 [Altitude] (AS3A). Measure of the symmetry of 
the pilot's performance of the maneuver as judged by aircraft altitude 
at various points* This includes checks on (a) altitude at 0 and 
180'' roll points and (b) comparison of the maximum and minimum altitude 
excursion with respect to the starting altitude. 



AS3A - 100 - 



60 



Attitude Score 3 [Total] (AS3T). Measure of the symmetry of the 
pilot's performance of the maneuver as judged by aircraft heading, pitch 
angle, and altitude at various points* This is composed of a scaled 
combination of the preceding three attitude measures. 

^S3T r AS3H ♦ AS3P ♦ AS3A 

3 

RPM Score (RPMS). Measure of how well the pilot achieves and 
maintains the required RPM on both engines throughout the maneuver. 

RPMS = 100 - 10 S,4 

g Force Score (GFS). Measure reflecting the amount by which the 
pilot exceeds the g-limits during the maneuver. 

100 s. 



GFS = 100 - 



'17 



3T 

where T - total time to complete maneuver (seconds). 

Roll Rate Score (RRS). Measure of the constancy of roll rate 
throughout the maneuver. 

RRS = 100 - -?3r- 
19 

Attitude Score 4 (AS4). Measure of how well the pilot's flight 
path compares with a criterion flight path based on a "best fit" of a 
correctly shaped flight path to the actual performance. 

AS4 = 100 - -r~ 
300 
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Total Score, Measures how well all criteria are met. 
SCORE = -^[6(AS4) + 5 (AS3T) + 4 (RRS) 

+ 4 (ASl) + 4 (AS2) + 3 (GFS) + 2 (EAS) + RPMS 

Miscellaneous Data: 

1. Time to complete maneuver 

2. Center headings of criterion circles 1 and 2 

3. Radius of criterion circle 3 




b. Software Implementation 

(1) Lazy 8 Program 

lazy 8 measurement program consisting of an executive 
routine and a large subroutine was written in FORTRAN IV and Implemented 
on an IBM 7094 computer. The executive routine required approximately 
300 FORTRAN statements and performed the following major functions: 

1. Search magnetic tape for the event number corresponding 
to the maneuver to be analyzed. 

2. Read the data. 

3. Generate basic plotting data. 

4. Print all pertinent data at intervals of 1/2 second. 

5. Call the measurement subroutine that computes the 
theoretical measures described previously. 

A listing of the executive routine is provided in Appendix VI. 
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The plotting data generated were for proc^ucing plots of the 
following variables: 

1. Roll vs Pitch 

2. Roll and Pitch vs Time 

3. Altitude vs Time 

4. Airspeed vs Time 

5. Heading vs Time 

6. Approximate Ground Track^ 

7. Cockpit Stick Position 

The data selected for print-out at two samples per second are: 



1. 


Roll 


2. 


Pitch 


3. 


Heading 


4. 


Altitude 


5. 


Airspeed 


6. 


Left RPM 


7. 


: '.a.it RPM 


8. 


Longitudinal Stick Position 


9. 


Lateral Stick Position 


10. 


Degrees of Turn into Maneuver 


11. 


Approximate Ground-Speed 


12. 


Vector for Computing Ground Track (ALTX) 


13. 


Acceleration 



This plot was generated using heading and a computed, approximate 
groundspeed (GS). The GS was calculated using simple trigonometric 
functions for the airspeed vector and pitch angle, and is accurate 
only for no-wind, small -angle-of-attack conditions. 
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The measurement subroutine required about 500 FORTRAN statements 
and performed the function of computing and printing the theoretical 
performance measures. 

Program execution required setup of two magnetic tapes, one of 
which contained the calibrated flight data and the other of which was 
a scratch tape for plotting-data. Program execution resulted in 
generation of (1) a plotting-tape, (2) data print-out, (3) theoretical 
measures, and (4) an estimate of the time requirement for the off-line 
plotting job. Subsequently, a request for plotting had to be 
submitted. Plotting time for each of the seven plots averaged 10.8 
minutes, using a Calcomp magnetic tape plotting system (30-inch drum). 

(2) Barrel Roll Program 

The barrel roll measurement program was implemented 
analogously to that for the lazy 8. The executive routine was nearly 
identical, the major differences being (1) a change in one of the 
plots produced, i.e., heading vs pitch instead of roll vs pitch; and 
(2) the variables were printed at 10 per second instead of 2 per second. 

The measurement subroutine required about 300 FORTRAN statements. 
The major functions of the subroutine are described in Appendix VII. 

Program execution procedures were the same as those described for 
the lazy 8 program. 

(3) Initial Tests 

Initial tests were made by analyzing the theoretical 
measurement program results of approximately 30 lazy 8 and barrel roll 
performances, flown by both Flight Test pilots and an instructor pilot. 
For each performance, a condensed print-out of critical variables, seven 
plots, and the previously described theoretically based measures were 
generated. This data was used in making a decision about formal 
analysis and measurement requirement^ for subsequent data to be collected 
in the study. 
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Appendix VIII illustrates representative print-outs and theoretical 
measures from the lazy 8 and barrel roll measurement programs. In the 
illustrated print-out for the barrel roll, the reader will note that 
two columns are devoted to each of the angles roll, pitch, and heading 
This was done to provide space for printing both the recorded angles 
and Euler angles, designed to be computed using recorded body-axis 
rates. This was considered desirable to perform a dual check on the 
recording of angular rates and the recorded angles. Unfortunately, 
one of the rate gyros developed problems during the study, and the 
Euler angles effort was abandoned to the priority of other matters. 
In the print-out, the columns containing all zeros were the ones 
intended to hold Euler angle data. 

- Figures 19 through 32 illustrate the set of plots produced for 
two sample lazy 8 performances. For each set of plots, indication is 
given thereon of the subjective rating assigned in-flight to the 
corresponding maneuver performance, the first having been rated a high 
"Good" and "Fair" for the second one. The performing pilot (a PIT 
instructor) illustrated typical performances and provided the subjective 
ratings himself subsequent to flying the maneuver. 

Two of the plots deserve special comment. The stick-position plot 
emulates the movement of the control -stick as "viewed" from the pilot's 
position in the cockpit. The plot is generated by graphing lateral 
(right/left) versus longitudinal (fore/aft) stick position. The roll 
versus pitch plot is overlaid on a linearized approximation of ATC 
criteria, as specified in the maneuver analysis. 

Early in the flight test and initial data analysis phase, it was 
realized that recorded aircraft heading (See Figures 24 and 31) would 
present problems. The directional gyro from which the recording was 
taken had the normal precession and lead^-lag errors to be expected in 
an instrument of its type and age. As a result, true aircraft heading 
could, at best, be only estimated during and immediately after aerobatic 
maneuvers. In addition, the method of instrumentation technique for • 
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Figure 19. Stick Position Plot for Lazy 8 
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Figure 20. Roll vs Pitch for Lazy 8 (12-17-69-'20/High Good) 



123 



AFHRL-TR-72-6 




AFHRL-TR-72-6 



fr 
i 
1 
} 




Figure 24. Heading vs Time for Lazy 8 
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Figure 25. Ground Track for Lazy 8 
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recording aircraft heading (See Section II) with the inherent limitation 
of the synchro-follower caused erroneous readings in the 0^90^ arc. 

Although the task-analysis data for the lazy 8 indicated that headlri) 
should be the basic measurement reference variable, we elected to omit 
it from the list of measurement variables for two reasons: (1) the 
problems experienced with its accurate recording, and the lack of tirr,e 
and money with which to correct the problems; and (2) the dependent 
nature of heading as a variable. We postulated that the variables 
roll, pitch, time, and airspeed would provide performance-relevant 
data which i'i inclusive of the information that aircraft heading 
provides. (In part, this was a rationalization of the problem at tho 
time the decision was made; after-the-fact, however, it appears 'co 
have been a justifiable move considering the scope of the effort.) 

Appendix IX illustrates nine additional sets of lazy 8 plots, 
excluding heading versus time and the heading-based plot of ground 
track. Again, the corresponding subjective ratings are indicated on 
the plots, and they are arranged in order of decreasing skill, as 
judged by the instructor pilot. 

. The theoretical measures and plots, such as those in Appendix IX, 
were used in making a number of the observations which helped to form 
a basis for specification and development of a revised measurement 
program. No attempt was made to -thorouglily test the validity of the 
theoretical measures other than to correlate them superficially with 
the instructors' subjective ratings. Primarily, their usefulness 
consisted of supplementing the plots to provide a better descriptive 
indication of the nature of the performance and in providing a 
preliminary indication of the utility of ATC-crlterion-referenced 
measures. The observations that were made will be discussed now 
through reference to the sample plots in Appendix IX, nurnuared 
consecutively 1-45 for aid in reference. 
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First consider the stick position plot. Selected plots of stick 
position were annotated by hand to show where various events took place, 
such as where the largest pitch angles occurred and where the maneuver 
was half-completed. The most significant observation was that as the 
aircraft initially approaches about 40 - 50° of turn in each half of 
the maneuver, the direction of movement of the stick was reversed. 
Apparently, this illustrates the pilot's attention to the over-banking 
tendency of the aircraft. A stick. position plot which annotates these 
points could beof value in basic flying instruction. A slight 
indication of increased stick movement as skill degrades was also 
noticed. An example of this may be seen by comparing Plot 1 with 
Plot 41 (Appendix IX). This trend was not always consistent, however, 
and could easily be caused by varying environmental factors in-flight. 

The analysis of stick position resulted in the decision to abandon 
its "further consideration in this study. Without scientific evidence, 
we propose that stick position analysis would be most applicable in 
(a) basic flying training studies and (b) take off and, landing 
studies. For documentation and possible reader interest, several 
additional stick position plots are presented in Appendix X. 

The roll versus pitch plot proved to be the most singularly 
informative plot of those considered. Consider Plot 2 in Appendix IX. 
This performance began to the left (can be seen from the initial roll 
direction in Plot 3). Initially, the pilot pitched up without rolling, 
then completed a roll to -90° with relatively little change in pitch. 
He 'reached -90° of roll and began a decrease in roll prior to attaining 
his zero pitch position. In the roll -out of the first half of the 
maneuver, he returned to zero pitch prior to wings level. In the 
second half, he attained maximum positive pitch at roughly 30° roll and 
held this pitch angle while he continued to roll through about 70°. 
Again, he reached maximum bank and began to roll out prior to zero 
pitch. Upon ending the maneuver, he reached zero pitch prior to wings 
level. In both halves of the maneuver, he pitched up further than he 
pitched down, which is contrary to the ATC criteria as presented in the 
task analysis. 
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The performance represented fey Plot 2 was rated low "Excellent." 
Comparing Plot 2 with Plots 12, 17, 22, 27, 32, 37, and 42 ("fair" and 
"unsatisfactory" performances), one can gain some immediate insights to 
measurement of the lazy 8 maneuver. For example, plot 2 exhibits 
symmetry, about the same pitch excursions in each half of the maneuver, 
and a relatively smooth, continuously changing roll/pitch relationship. 
All- or some of these characteristics are lacking to some degree in the 
other plots. In plot 32, for instance, roll is held relatively constant 
at the MAX-roll points in the maneuver, and pitch is allowed to reduce 
from a MAX plus to a MAX minus all at once. In plot 37, very little 
change in pitch is exhibited while a rapidly changing roll is evident. 
In plots 12 and 17, lack of symmetry is obvious. In plot 42, uneven 
change in roll with respect to pitch is seen .at the end of the left half 
of the maneuver. Additionally, by considering the roll-pitch plot and 
the airspeed plot together, it is possible tc postulate precisely why 
(or why not) the airspeed criteria are met by a given performance. As 
will be discussed later, it appears likely that an individual trained in 
interpreting the plots can accurately discriminate at least four skill 
levels using only" the roll-pitch and airspeed plots. 

The plot of roll and pitch versus time provided little contributing 
information relevant to measurement that could not be deduced from other 
plots. The altitude plot was considered possibly relevant because in 
the better perf rmances there was a consistent overall altitude gain 
that was not observed consistently in the less skilled performances. 
Also, the reason for this altitude gain in correct performance of the 
lazy 8 was an intriguing question. Appendices XI and XII present 
additional roll versus pitch plots and airspeed plots which represent 
the same group of performances shown in Appendix X. 

c. Summary of Theoretical Measures Investigation 

Theoretical measures were determined using the ATC maneuver 
analyses, in which criteria and tolerances were estimated for various 
flight parameters. The measures consisted of comparisons of flight 
data with these criteria and tolerances. 
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Programs were written to (1) compute and print out the theoretical 
measures; (2) print the raw data itself; and (3) plot selected 
variables. The programs were run using a small amount of flight test 
and instructor pilot performance data. 

Essentially, the theoretical measures investigation was an initial 
"shot-in-the-dark" using, as a basis for trial measurement, the ATC 
information available at the start of the program. For launching the 
study and bringing to light both the operational and theoretical problems 
regarding measurement of the" lazy 8 and barrel roll, the investigation 
was 100% successful. However, for demonstrating any kind of validity 
of the theoretical measures (and, thus, encouraging the investigators at 
that time), the results may be considered disastrous. 

A serious problem occurred that was not originally anticipated with 
regard to the use of aircraft heading as a primary reference variable. 
Due in part to instrumentation problems, and due in remainder to the 
lead/lag characteristics of the heading gyro from which the recording 
was taken, heading itself was- unreliable. Therefore, any measure 
which relied on heading as a reference was unreliable. 

From the data plotted in the theoretical measures investigation, it 
was possible to discern a number of questionable characteristics of the 
ATC criteria that were applied. A prime example is the criterion that 
maximum and minimum pitch angles be equal in magnitude. Other criteria 
appeared to be valid and to represent a sound basis for measurement, e.g. 
the "circle" measures for the roll/pitch relationship in the barrel roll. 

Based on observations such as these, it was concluded that textbook 
criteria very definitely cannot be assumed to represent an adequate basis 
for quantitative measurement, although it may provide initial guidelines 
Rather than pursue this avenue further, (i.e., attempt to legitimately 
validate or disprove the original set of ATC criteria), the decision was 
made to formulate a new set of measures. This new set was based not on 
ATC criteria, but on (1) a logical analysis of that criteria made 
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possible through the initial application; and (2) insights into the 
performance of the maneuvers gained through examination of actual data. 

The new set of measures and other related program ojutputs considered 
necessary to conduct the study constitute the measurement system 
ultimately applied to a broad spectrum of student and instructor data. 
This measurement system is described next. 

4. MEASUREMENT SYSTEM 

This subsection describes the measurement system designed for 
analyzing performance and computing measures for a broad spectrum of 
student and instructor lazy 8*s and barrel rolls. Prior to the 
specification of this system and the associated measures, an investigation • 
was made of a set of theoretical measures based solely upon ATC criteria. 
As discussed in the preceding summary, this investigation laid the 
groundwork for identification of the measures and other desirable 
program-outputs to be described below. To differentiate the measures 
to be described below from the theoretical measures previously discussed, 
the new ones will be referred to as experimental measures. (This name 
also attests to the fact that the new set of measures is experimental 
in nature.) The measurement system consisted of separate programs for 
the lazy 8 and barrel roll which (1) computed experimental measures, 
(2) plotted key performance variables, and (3) produced a summary 
print-out of measurement-relevant raw data. In addition, initiating 
programs were developed to record significant data on cards for each 
maneuver, which was then used as input to the actual measurement 
programs. 

a. Punched Card Records of Maneuvers 

Considerable difficulty was encountered in locating and reading 
maneuver data on magnetic tape. This difficulty was attributed to three 
factors: (1) the magnetic tapes were not new, (2) the identifying 
event numbers for the maneuvers were often not recorded correctly on the 
tape due to instrument errors, and (3) the data typically contained 
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"glitches" apparently caused by intermittent noise on the recording 
channels. Because the data would require more than one "pass" for 
analysis, and because it was to be retained for other future studies, 
it was necessary to "deglitch" the data and store it on punched cards. 
The variables to be thus recorded were selected on the basis of their 
expected usefulness in measurement of .performance. 

The variables selected for storage on cards were as- follows (shown 
in the order punched); 



Lazy 8 

Roll 

Pitch 

Heading 

Altitude 

Airspeed 

(AT = 0.5 sees) 



Barrel Roll and Other Maneuvers 
Roll 
Pitch 
Heading 
Altitude 
Airspeed 

Normal Acceleration 
(AT = 0.4 sees) 



The program which accomplished the punching and which, additionally, 
printed out selected variables is listed in Appendix XIII. .For the 
lazy 8, 1.5 seconds of data could be represented on each punched card, 
resulting in approximately 40 or 50 cards per performance. For the 
barrel roll (and all other maneuvers), one card represented .8 seconds 
of data, resulting in about 40 cards per performance of the barrel roll. 



In addition to the recorded data, cards were punched to document the 
month, day, year, and event-number of the maneuver, the total number of 
data points punched, the subjective rating provided for the maneuver, 
and, when applicable, the direction in which the maneuver was performed, 



ERIC 
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Data "deglitching" was accomplished partly by the program and partly 
by hand- The program, prior to punching, checked for obvious recording 
errors (e.g., variables out of range) and corrected the de*a at that 
point by setting it equal to the preceding values. Hand analysis was 
then required to remove "glitches" overlooked by the program and, 
when necessary, smooth out the step-function effect sometimes resulting 
from corrective action of the program over a longer-than-ordinary time 
interval. This process worked satisfactorily but was extremely time 
consuming. 

The format in which the cards were punched is as follows: 

Card 1: Month, Day, Year, Event Number 3I5,F7.0 

Card 2: Number of recorded points 15 

Card 3: Rating, Direction 215 

Remaining Cards: Data for lazy. 8 3(F5.0,F4.0,F5.0, 

F7.0,F5.0) 

Data for barrel roll and others 2(F5.0,F4.0,F5.0, 

F7.0,F5.0,F5.1) 

b. Lazy 8 Experimental Measures 

Following is a description of forty-one measures designed to be 
computed for each performance of the lazy 8 maneuver: 

(1) MAX^ - Maximum positive pitch in first half of maneuver 

(2) MIN^ - Minimum pitch in first half of maneuver 

(3) MAXg - Maximum pitch in second half of maneuver ' 

(4) MINg - Minimum pitch in second half of maneuver 
(5-8) ROLL, (i = 1, 4) 

Roll, airspeed, and altitude 
change [since start of maneuver] 
at points of MAX,, MIN,, MAX^, 
and MINg- ' ' ^ 



(9-12) ARSP. (i = 1,4) 



(13-16) ALTX. (i = 1,4) 

(17) MAX + ROLL - Maximum positive roll 



137 



AFHRL-TR-72-6 



(18) 
(19) 
(20) 
(21) 
(22) 
(23) 
(24) 
(25) 
(26) 

(27) 

(28) 
(29) 



MAX - ROLL - Maximum negative roll 

Time Half 1 ] 

[ Time (seconds) required to perform 

Time Half 2 J each half of the maneuver. 

Total Time - Total maneuver time 

- Starting airspeed minus 200 

Eg - First minimum airspeed minus 100 

Eg - MAX airspeed at middle of maneuver minus 200 

E^ - Second minimum airspeed minus 100 

Eg - Ending airspeed^minus 200 

i = 1 

1 = 1 

^8= ^ l^il 



(30) 
(31) 

(32) 

(33) 

(34) 

(35) 

(36) 
(37) 
(38) 

(39) 



-10 



-n 



-12 



-13 



-14 



-15 
'16 



Absolute value of the airspeed- 
change between the five local 
maxima and minima (e.g., = 
abs. val. of difference between 
starting airspeed and first local 
minimum airspeed). 



IChange in airspeed I divided by 
change in time over the four 
intervals of the maneuver 
referenced above by Eq through 

"12* 



Time (seconds) during intervals 
referenced above by Eg through 

E^2 3nd E^2 through E^g, 
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(40) T3 

(41) ; 

In addition, measures of roll, airspeed, and altitude excursion 
are computed at specified points throughout the maneuver* The points 
are composed of all local maximum and minimum pitch values plus 
intermediate points at multiples of 1/3 times the local extrema* 



The measures program pjioducfis^pr: each performance of the lazy 8, 
(1) a print-out of roll, pitch, heading, altitude, and airspeed at 
AT = 0.5; and (2) the experimental measures* In addition, the 
program computes means and standard deviations of all measures for selected 
groups of performances* Sample output is shown in Appendix XIV. 

, c. Barrel Roll Experimental Measures 

Following is a description of thirty-six measures designed to 
be computed for each performance of the barrel roll maneuver* 



(1) Symmetry Measures 

Let X^. = pitch values sampled at | roll j 



= 10°, 20°, 
180°, 170°, 
10°* 



(i = 1, 35) 



^1 9 



^ Z (1^1 j " I ^36-i|) Meosures symmetry 

of quarters I ond 4 



" 9 ^ l^36-i|) Meosures symmetry ^ 



of quarters 2 ond 3 



tv yf 



Oy I ^ I y I \^ Meosures symmetry 
'I I "-'!) ^Th^ es I ond 2 
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(2) Roll/Pitch Circle Measures 

Let Roll^ and Pitchy (i = 1> 71) be the sampled roll values 
and corresponding pitch angles at Roll = 5®, 10®, 180**, 175**, 

• • • • f ^ • 



Let 

X, = I ROLL, I -90 



90 (pitch,) 



where Pitchj^^ = maximum absolute value of all Pitchy 



Then 



lyi J. I / ^ Compof $ foU ond pitch with 

^ 3^ V J c\fc\% Cfif fion ovtf holf 1 

^ ^ J_ / T Compof $ foll ond pitch with 

5 - 36 V j^^^ i cifcit Cfitarion ovr holf 2 



^ J] Zj Compof s foll ond pitch with 



i=i cifcia Cfitarion ovf moneuvtr 

p) Constancy - Measures on Rates and g's 

These measures check the constancy of roll rate, pitch rate, 
and g's by computing regression coefficients and correlation. 

Let Roll., Pitch., and G. be the values of roll (arranged to go 
ill 

from 0 to 360**), pitch, and g's at time-increments of 0.4 seconds 
(i = 1, K). Using a 5-point Lagrange formula, compute: 



Y^^ = roll rate 
= pitch rate 
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and denote 



^31- = "^i . 
X. = Roll. 



Def i ne 



Then 



8l = 



kIZ X, x,)( ! vj 



K 
I 



K 



K 



K 

I 



^8= ^1 

^11 = h 
^2 = ^2 
^13 = ^3 
^4 = ^3 
^15 = R3 



Ron rate regression coefficients 
Ron vs. ron rate correlation 
Pitch rate regression coefficients 
Ron vs. pitch rate correlation 
. Normal acceleration regression coefficients 
Ron vs. normal acceleration correlation 
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Let M be the value of i at the point where Roll, first becomes ^ 45*", 
and let N be the value of i at the point where Roll^. last is > 45^. 
Set j = 1 at i = M, and j = K = N-M+1 at i=N, Compute , for i = 16, 
24 by replacing i with j in the foregoing analysis. Then M ^^ to M^^ 
are the same measures as M -^ to M^^ over the interval I Roll I ^ 45, 

(4) Miscellaneous Measures 

- Maximum g's in first half 

- Maximum g's in second half 

- Minimum g's in whole maneuver 

- iRoll I at MAX positive pitch 

- |Ro11 I at MAX negative pitch 

- Maximum roll rate 

- Minimum roll rate 

MAX. and MIN. pitch rate 

- Total time for maneuver 
= Time for first and seconc| I alves 

4 

In addition, measures of pitch, roll rate, pitch rate, roll-pitch 
"error" (based on circle criterion), heading excursion, altitude 
excursion, and airspeed excursion are computed for every lO"" of roll. 

The measures program produces, for each performance of the barrel 
roll (1) a printout of roll, pitch, heading, altitude, airspeed, 
and g's at AT = 0.4; and (2) all experimental measures described 
above. Sample output is shown in Appendix XV. 



(1) 


^^25 


(2) 


^^26 


(3) 


^27 


(4) 


^28 


(5) 




(6) 


^^30 


(7) 


^^31 


(8) 


^^32 


(9) 


M33 


(10) 


"34 


(11) 


^'35 


(12) 


"36 
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d. Debriefing Plots 

A debriefing plot, as the term is used in this study, is a graph 
of one or more flight variables which, when supplemented by selected 
performance measures, assists one in evaluating the perfomance 
diagnostically. Through a select combination of debriefing plots and 
measures, the authors' intent was to show that performance can be 
evaluated after-the-fact more diagnostically and with better skill 
discrimination than is possible (or at least feasible) in-flight. 

Three such plots were developed for the lazy 8: 

1 . Airspeed vs time 

2. Pitch vs roll 

3- Altitude vs time 

In addition to generating the plots themselves, computer programs 

also annotated each plot with measurement-relevant information. For 

example, the airspeed plot was designed to include the location and 

value of local maximum and minimum pitch values. 

# 

V 

Examples of these plots for four laxy 8 performances are presented 
In Appendix XVI • In addition to the computer generated graphs and 
annotations, additional comments are included on the plots to 
(1) explain the annotations and (2) point out some highlights 
illustrating the type of diagnostic information contained in the plots. 

Eight debriefing plots were designed for the barrel roll: 

!• Ron, pitch, airspeed, and altitude vs time 

2. Heading vs time 

3. g*s vs time 

4. I Ron I vs Pitch 

5- Ron/Pitch Polar Plot 

e = Ron 
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R = I Pitch I 

Plot X = R cos d vs Y = R sin d 

6. Pitch vs Roll 

7. Altitude vs Roll 

8. g's vs Roll 

Examples of these plots for two performances of the barrel roll are 
Illustrated In Appendix XVII. 

e. Suranary of Experimental Measures 

Section VIII of this report discusses the results of applying 
the experimental measures to a broaa selection of student and Instructor 
performances. For convenience In reference, the experimental measures 
are sunmarlzed below: 

(r- Lazy 8 



No. 


Units 


Experimental Measures 






1 


Oeg 


Max. (positive) 


pitch In half 1 


(max. 


1) 


2 


Oeg 


Min. (negative) 


pitch In half 1 


(min. 


1) 


3 


Oeg 


Max. (positive) 


pitch In half 2 


(max. 2) 


4 


Oeg 


Min. (negative) 


pitch In half 2 


(min. 


2) 


5 


Oeg 


Roll at max. 1 








6 


Oeg 


Roll at min. 1 








7 


Oeg 


Roll at max. 2 








8 


Oeg 


Roll at min. 2 








9 


Kt 


Airspeed at max. 1 








10 


Kt 


Airspeed at min. 1 








n 


Kt 


Airspeed at max. 2 








12 


Kt 


Airspeed at min. 2 
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No. 


Units 


Experimental Measures 


13 


Ft 


Altitude excursion at fnax. 1 


K 


Ft 


Altitude excursion at min. 1 


15 


Ft 


Altitude excursion at max. 2 


16 


Ft 


Altitude excursion at min. 2 


17 


Deg 


Max. positive roll 


18 


Deg 


Max. negative roll 


19 


Sec 


Time to perform half 1 


20 


Sec 


Time to perform half 2 


21 


Sec 


Total time for maneuver 


22 


Kt 


Start airspeed - 200 


23 


Kt 


1st min. airspeed - 'lOO 


24 


Kt 


Max. airspeed, end 1st half, - 200 


25 


Kt 


2nd min, airspeed - 100 


26 


Kt 


End airspeed - 200 


27 


Kt 


Sum of measures 22-26 (all maneuver) 


28 


Kt 


Sum of measures 22-24 (half 1) 


29 


Kt 


Sum of measures 24-26 (half 2) 


30 


Kt 


Airspeed excursion 1st quarter 


31 


Kt 


hi; speed excursion 2nd quarter 


32 


Kt 


Airspeed excursion 3rd quarter 


33 


Kt 


Airspeed excursion 4th quarter 


34 


Kt/Sec 


Rate of change of airspeed 1st quarter 


35 


Kt/Sec 


Rate of change of airspeed 2nd quarter 


36 


Kt/Sec 


Rate of change of airspeed 3rd quarter 


37 


Kt/Sec 


Rate of change of airspeed ^th quarter 


38 


Sec 


Time 1st quarter 



ERIC 
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tl 



ERIC 



No* Units Experimental Measures 

39 Sec Time 2ncl quarter 

40 Sec Time 3rd quarter 

41 Sec Time 4th quarter 

(2) Barrel Roll 

No> Units Experimental Measur es 

1 Non-Dim. Symmetry between quarters 1 and 4 

2 Non-Dim. Syrranetry between quarters 2 and 3 

3 Non-Dim. Symmetry between halves 1 and 2 

4 Non-Dim. Comparison with circle - half 1 

5 Non-Dim. Comparison with circle - half 2 

6 Non-Dim. Comparison with circle - maneuver 



7 Non-Dim. 

8 Non-Dim. 



1 



13 Non-Dim. 

14 Non-Dim. 



Roll rate regression coefficients 



9 Non-Dim Correlation: roll vs roll rate 

10 Non-Dim. 

11 Non-Dim. 

12 Non-Dim. Correlation: roll vs pitch rate 



Pitch rate l^egression coefficients 



) 



Nonnal acceleration regression coefs, 



15 Non-Dim. Correlation: roll vs normal acceleration 

16-24 Non-Dim. Same as 7-15, but for |Roll| > 45° 

25 ■ g Max. g half 1 

26 g Max. g half 2 

27 g Min. g whole maneuver 

28 Deg Roll at max. positive pitch 
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No. 


Units 


Experimental Measures 


29 


Deg 


* 

Roll at max. negative pitch 


30 


Deg/Sec 


Max. roll rate 


31 


Deg/Sec 


Min. roll rate 


32 


Deg/Sec 


Max. pitch rate 


33 


Deg/Sec 


Min. pitch rate 


34 


Sec 


Total time for maneuver 


35 


Sec 


Time half 1 


36 


Sec 


Time half 2 
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SECTION VI 
FLIGHT TESTING AND DATA COLLECTION 

The calibration of the data acquisition system was conducted 
principally at Wright-Patterson AFB, whereas the data collection flights 
on maneuver performance were accomplished predominantly at Williams AFB. 
Specifically, a total of 40 calibration flights and 51 maneuver data 
collection flights were conducted throughout the program. However, 17 
of the flights flown in support of the Pilot Performance Measurement 
Program resulted in no useful data being obtained due to system 
malfunction or weather. The total flying time on 948 was 114.7 hours 
over 91 sorties. 

Maintenance support for the aircraft and data acquisition system 
was provided by Flight Test at Wright-Patterson AFB and by Air Training 
Command technicians assigned to the Directorate of Maintenance at 
Williams AFB. Pilots from the Fighter Test Squadron and AFHRL research 
psychologists flew the calibration flights. All of the UPT student 
data collection flights were flown at Williams AFB with one of the AFHRL 
instructor pilots. 

1. OPERATING PROCEDURES 

The procedures discussed in this section have evolved from 
operational experience with the data acquisition system and resulted 
In the development of the most efficient method of recording calibration 
and maneuver data, within specific restrictions, for pilot performance 
meas'irement research. 

a. Tape Handling 

Prior to each flight, the one inch mag tape was installed in 
the Leach tape recorder according to the following procedures: 

1. Check that all cockpit switches on the Recorder Control 
Panel are in the OFF position. 
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2. Apply 28 VDC ground power to the aircraft. 

3. Turn the recording system MASTER SW to the ON position 
on the cockpit Recorder Control Panel. 

4. Raise the guard on the GROUND TO FLIGHT switch and move 
this switch to the GROUND position. 

5. Turn the TAPE RECORDER POWER switch to the ON position. 

6. Remove the cover on the Leach tape recorder located in the 
lower fuselage bay area, 

7. Check that the recorder POWER switch is in the ON position 
(When power is on, the- STOP button will be RED). 

8. Load the mag tape on the recorder with the supply reel on 
the right and take up reel on the left. 

9. Actuate the FAST FORWARD switch and allow the tape to run 
for five seconds before activating the STOP button. 

10. Place cover on tape recorder. 

11. Return the TAPE RECORDER POWER switch to OFF position on. 
cockpit Recorder Control Panel. 

12. Return the GROUND TO FLIGHT switch to ON position (guard 

down). 

13. Return COUNTER to zero. 

14. Return MASTER SW to OFF position. 

Subsequent to the flight, the tape was down-loaded and transported 
to the Data Reduction Branch of Flight Test. At Williams, the tapes 
were boxed and shipped via commercial air the same day of the flight. 
It became imperative to reduce the tape and print-out the data as quickly 
as possible in order to ascertain if all the parameter sensor systems 
and the tape recorder were operating properly. A minimum of three days 
was normally required between the student data flight at Williams AFB 
and a check of the data that was performed by the authors at Wright- 
Patterson. 
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b,* Recorder Operating Procedures 

Upon taxiing to the number one position for takeoff, the data 
acquisition system was turned to a standby mode and an automatic 
calibration cycle initiated as follows; ' ' 

1 . MASTER SW - ON 

2. INVERTER switch - ON, red light out 

3. PCM/DAS switch - ON 

4. RECORDER POWER switch - ON, 

(TAPE OFF amber light on) 

5. Check GROUND TO FLIGHT switch - ON 

(guard down), green light on 

6. TIME CODE switch - ON 

7. RECORDER CONTROL switch - ON 

8. Complete equipment calibration check; 

(rapid sequence) 

a. Change record number 

b. Depress AUTO CAL button 

c. Change record number 

9. RECORDER CONTROL switch - OFF 

After flying under radar control to the designated area where the 
calibration tests or maneuvers were to be performed, the instructor 
pilot commenced the data collection by turning the RECORDER CONTROL 
switch to the ON position and changing the record number by depressing 
the RECORD NO. button. The record number was changed at the beginning 
and end of each maneuver in order to facilitate the visual examination 
of the data print-out and provide discrete events for computer data 
processing. The recorder was turned off during extended periods of 
time when data was not being scored, such as climb and descent. By 
employing this method of tape conservation, the 60 minute mag tape 
was of sufficient duration to record in excass of the ave age mission 
flying time of 1 .3 hours. 
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Frequently the audio tape recorder was utilized on the mission. 
It proved to be an effective method for obtaining the instructor pilot's 
comments and critique of the student's performance narrative account of 
a maneuver being demonstrated by the IP, weather information, system 
malfunctions, and other qualitative data pertinent to describing the 
quantitative recording of performance. 

2. CALIBRATION PROCEDURES 

Precise procedures were established for the calibration of the 
flight and engine parameters with the corresponding cockpit' instrument. 
The flight crew was briefed on the parameters and method of calibration 
prior to each flight. A Test Data Card was used to indicate the 
parameters to be calibrated and the value and record number of each data 
point. Additional information that was written on the Test Data Card 
included: 



1. 


Aircraft type and number (T-37B/948) 


2. 


Flight test project number (7184/604) 


3. 


Date 


4. 


Flight number 


5. 


Pilot 


6. 


Data recorder 


7. 


Takeoff time 


8. 


Landing time 


9. 


Mission duration 


10. 


Current altimeter setting 


n. 


Auto calibration record number 
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The basic parameter calibration procedures were provided to the 
flight crew in the form of a checklist: 

1. Set current altimeter setting in left altimeter and record 
setting on Test Data Card. 

2. Prior to recording any calibration data, depress the AUTO 
CAL. button for one second with the recorder on. 

9 

3. Turn recorder on for the entire period that one parameter is 
being calibrated, so that data will reflect transition from one step to 
another. 

4. Obtain a minimum of 5 seconds* scoring for each incremental 
step after the parameter is stabilized at the desired value. 

. 5. Upon stabilizing at a new parameter step, depress RECORD NO. 
button to advance the counter, which signals the beginning of a 5-second 
scoring period. 

6. Write counter reading on Test Data Card for each parameter 

step. 

7. Complete the scoring in succession when two steps are 
designated by a bracket. 

8. Any deviations from normal calibration procedures should be 
noted on the data card or audio tape recorder. 

Checklist item number 7 refers to a procedure used during the calibration 
of a parameter of reversing the established trend to determine if the 
resolution of the sensor system would be able to identify a small change 
in the opposite direction^ Another technique used was to calibrate the 
parameter entirely in one direction (e.g., increasing airspeed) and 
then repeat the same data points but proceeding in the opposite direction 
(e.g., decreasing airspeed). Thus, two recorded data points could be 
compared for the same parameter value so that an assessment could be 
made of the reliability of the sensor system. 
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Table XIV indicates those parameters that v/ere able to be calibrated 
in-flight, the range oViT which the calibration occurred, incremental 
steps established, and the magnitude of the reversal interjected in the 
general trend of the parameter. 

3. MANEUVER DATA COLLECTION PROCEDURES 

Flights conducted to gather maneuver performance claUt froin instructor 
pilots and UPT students utilized the same operational procedures 
previously described in thib section, plus several additional procedures. 

The AFHRL instructor pilots provided descriptive information 
regarding the student on the Test Data Card as follov/s: 

1. ATC Syllabus Instructional Unit flown (Sorties were all 
from the Contact, Dual, Advanced Maneuvers Instructional Units). 

2. Number of last Contact, Advanced Manauver Instructional Unit 
Flown, including date of flight, and whether flight was dual or solo. 

3. Total hours of T-37 flying time accuuiulated by the student 

to date. 

4. Prevailing weather: ceiling, visibility, turbulence. 

5. Instructor comments on capability of student with respect to 
the class norm at that stage of training (e.g., low average^ outstanding, 
solid and smooth student). 

6. Mid-phase (contact) check ride grade. 

7. Coded description of the maneuver performed such as L-8-L, 
a lazy-S initiated to the left; B-R-R, a barrel roll to the right; 
PATT-L, a normal 360"" overhead traffic pattern with a left break. 

Instructor's grade on each maneuver perfor^fied by a student, 
another instructor pilot, or a maneuver demonstrated by che AFHRL IP. 
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The rating system employed on the maneuver data collection flights 
was the standard ATC rating scale. This is an absolute rating scale 
whereby the student's performance is judged against the perfectly flown 
maneuver whether he is an experienced instructor or a neophyte student 
pilot. No consideration Is given to the type or amount of training the 
student has received. The categories of the rating scale are: 

Excellent (E) - The student performed the maneuver correctly, 
quickly, and efficiently. 

Good (G) - The student performed the maneuver with little hesitation 
and no assistance. 

Fair (F) - The student performed the maneuver, but made some false 
starts, repetitions, or minor errors of omission or commission. 

Unable to Accomplish (U)^ - The student lacked sufficient knowledge, 
skill, or ability to perform the maneuver without assistance. . 

Another procedure instituted for the maneuver data collection flights 
was a brief calibration of several parameters during the climb or 
immediately after level off. The purpose of this calibration procedure 
was to ascertain, on a regular basis, that the more important sensor 
systems and magnetic tape recorder were operating properly. The 
instructor recorded a single data point and record number on the Test 
Data Card while the student flew the aircraft in a steady-state condition 
on the following parameters: 

1. Heading 

2. Altitude 

3. Airspeed 

4. Pitch Angle 

5. Roll Angle 

'sometimes referred to in the report as unsatisfactory. 
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6. g Force 

7. RPM 

Immediately upon receipt of the computer print-out from these 
maneuver data flights, the authors would visually examine each of these 
seven parameters at the specific record numbers indicated on the Test 
Data Card. A comparison was made of the recorded data point and the 
instrument reading to determine If the data point fell within the normal 
resolution capability for that parameter. Also, a flight-by-flight plot 
of each parameter was accomplished to provide trend information on the 
reliability pf the parameter sensor system.' If any malfunction was 
revealed in the data acquisition system during these cursory calibration 
checks, the data collection flights were temporarily suspended until 
the equipment problem had been analyzed and corrected by the 
instrumentation technicians. The infrequent system malfunctions 
usually required the magnetic tape recorder head to be cleaned or the 
tape drive unit to be repaired. 

a. UPT Student Data 

A total of 31 UPT student pilots from the classes of 7105 and^ 
7106 flew aircraft 948 on maheiivsr data collection flights conducted by 
the two AFHRL instructor pilots. Table XV presents a summary of these 
flights. 

The original plan developed for the UPT data collection phase was 
that nine to twelve UPT student pilots would be randomly selected from 
two flights from each of the two classes. The intent was to collect 
maneuver data from these students at approximately four intervals during 
rheir Contact, Advanced Maneuver phase of flying. In this manner, the 
authors felt that representative data would be acquired to reflect the 
learning process on the two primary inaneuvers, lazy 8 and barrel roll. 
However, as shown in Table XV, only six of 31 students flew more than 
one data collection flight in 948. Such factors as the rapid rate of 
student progression in the T-37 phase, conflict in scheduling missions 
for the appropriate ATC instructional units, turn-around capability 
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TABLl XV 

SUIWRY OF UPT STUDENT DATA COLLUCTjON FLIGHTS 
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of 948, and the requirement to fly UPT students on a non-interference 
basis an posed serious limitations to the achievement of the original 
goals for student data collection. • In effect, the data acquired 
provided a larger sample size and thus a more representative range of 
skin level of UPT student pilots, from which to draw lazy 8 and barrel 
ron maneuver data for the analysis and development of performance 
measures. However, measurement validation was hampered due to lack of 
sufficient data per individual student. 

b. Instructor Pilot Data 

Maneuver data was collected from five T-37 instructor pilots and 
is summarized in Table XVK A highly qualified instructor from the 
T-37 Pilot Instructor Training (PIT) program was temporarily assigned to 
the Pilot Performance Measurement System program for the purpose of flying 
lazy 8 and barrel roll maneuvers that represented the range of skill 
manifested by UPT student pilots on these maneuvers. The PIT IP flew 
at least 10 lazy 8's and 10 barrel rons for each of the four skill 
rating categories - E, G, F, and U. Additionally, the IP described the 
maneuver verbally as he was performing it. Recorded on the audio tape, 
the narrative consisted of pointing out the significant parameters and 
criterion points utilized to teach the m?«^euver in ATC, normal range of 
values around the criterion points, factors that affect the IP*s rating 
of the maneuver, and common errors experienced by UPT students, 
examples of the IP's description of the maneuvers can be found in the 
following Section. 

Instructors 1 and 2 were the AFHRL IP's that conducted the student 
data collection flights while Instructors 3 and 4 were line ATC IP's. 
The maneuver data from these five instructor pilots provided the 
authors with base-line data with which to formulate performance measures 
for the quantitative assessment of student pilot performance. 
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Summary 

I Sevp^^al factors were encountered in the flight testing and data 

collection phase that, to a certain extent, altered the design of i>e 
Pilot Performance Measurenient System program* Primarily these factors 
consisted of limitations in the recording of the heading parameter, 
reduced resolution capability for altitude, reliability problems 
experienced with the magnetic taoe recorder, and the difficulty in the 
. timely scheduling or UPT student pilots. This in no way detracts, 
however, from the achievements and effectiveness of the program which, 
in retrospect, is considered to have been quite successful* 
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SECTION VII 
MEASUREMENT ANALYSIS 

this Section, final measures are developed for recommended 
applications in measurement of the lazy 8 and barrel roll. Also 
included are some relevant observations that unfolded regarding 
Standardization within and between instructors in both their 
performance and rating of the maneuvers, perfoi-mance criteria, and 
methods that should be employed in developing and validating measures 
in future efforts. 

The authors have elected to present these findings in the general 
order in which they developed during the investigation. First, lazy 8 
measunC'S for the instructor pilot from the ATC Pilot Instructor Training 
(PIT) school are summarized and discussed. The measures are correlated 
with the subjective ratings, which were provided in-flight by the 
performing pilot. This is done for the purposes detailed on pages 16-17 
of this report. With the guidance of these correlations, and with the 
added benefit of observing trends of the measure^- (mean and standard 
deviations) across different skill levels, a simple confcination of 
selected measures is then developed and shown to account, in itself, 
for at least 67% of the variance in subjective ratings. 



The AFHRL instructor pilots' lazy 8 performances are then examined*. 
Due to a deficit in the amount of data collected on instructors as well 
as a lack of even distribution of the performances across all four 
subjective rating categories (as judged by the instructors themselves 
in-flight), the only topic pursued is inter- and intra-instructor 
variance in performance. For this investigation, the PIT instructor 
pilot is compared with AFHRL and ATC instructor pilots. It can be 
shown, for example, that if two different IP's demonstrated the lazy 8 
for a given student, one could expect as much as 27 knots difference 
in the value of airspeed at one critical point in the maneuver. 
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Next, experimental measures for student perfonnances of the lazy 8 
are examined. As in the case of the PIT IP data, correlations are 
computed between measures and subjective ratings. Contrary to the PIT 
data, few of the correlations are significant, and the simple combined 
measure which discriminated skill levels quite well in the PIT case 
appears worthless when applied to the student data. 

At this point, the subject of validation technique is addressed. 
The authors propose (and, bi't for lack of sufficient data, would have 
used) within-subject samplinc as an ultimate basis for validation as 
well as development measurt*. This validation technique is 
demonstrated by using data for one student, for which, fortunately, 
sufficient data were collected to at least illustrate the concept. 
Despite the complete lack of validity of the combined-error measure 
seen in its application to student data and comparison v/ith subjective 
ratings, validity is supported by the trend o*^ the measure, as it 
varies across one student's performances. 

To further support the lack of confidence that should be placed in 
subjective ratings as evidence of measurement validity, a comparison is 
made of instructor?' rating standards. This is pursued by comparing the 
co»^relations between measures and subjective ratings for one IP v/ith 
those for a second IP. It is shown that while the number of 
significant correlations does not increase appreciably when considering 
one IP at a time, thp strength of the correlations for various measures 
differs markedly between the two IP's., This suggests a difference in 
emphasis that is placed by the two IP's on various aspects of the 
performance. 

Finally, for the lazy 8 at least, a set of final measures is 
recommended along with a summary of related findings. 

The barrel roll is troated next, but not as extensively as the 
lazy 8, due to lack of sufficient data. The experimental measures 
for student data are presented as well as their correlations with 
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subjective ratings. The indications are that to a much greater extent 
than in the lazy 8, standards must be determined for the barrel roll. 
Based on the data examined, specific measures are recoi^mended for 
validity testing in future studies. 

Finally, some plots of selected variables for other maneuvers are 
presented. The maneuvers are: 

Loop 
Stall 

CI overleaf 

Max. Performance Climbing Turn 

Immelmann 

Cuban 8 

These maneuvers were not addressed from a measurement standpoint, but 
are briefly presented here merely for possible reader interest. 

With this introduction, the next topic presented is the measurement 
analysis, beginning with the lazy 8. 

1 . LAZY 8 

a. PIT Instructor/Pilot 

For 47 performances by a <:-fn-"»^ PIT instructor, the experimental 
measures were computed. The performances were rated in-flight by the 
performing pilot, and the ratings are distributed across the four rating 
categories as shown in Figure 33. 

For each measure, the nean and standard deviations were plotted as 
shown in Figures 34 through 39. In addition, each measure was 
correlated with the subjective ratings assigned to each performance. 
The resulting correlation coefficients are presented for all 
performances, all right performances, and all left performances in 
Table XVII. 
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TABLE XVII 

CORRELATIONS BETWEEN MEASURES AND SUBJECTIVE 
RATINGS FOR PIT INSTRUCTOR LAZY 8 PERFORMANCES 
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Debriefing plots for each performance were also produced and used as 
an aid in the analysis. Where available the pilot's voice transcript 
was attached to the appropriate set of plots. Sample piots for one of 
the performances are presented in Figures 40 through 42. (Refer to 
Appendix XVI for interpretation of the plots.) 

Using this data it was possible to make a number of general 
observations that provide insight to general performance of the lazy 8 
as well as to its measurement. These observations are presented next. 
They are based primarily on the data in Figures 34 through 39. 

(1) General Observations 

The following observations are based exclusively on the PIT 
Instructor performance data as shown in Figures 34 to 39, Table XVII, 
and (althoug*! not shown) the debriefing plots. In the ensuing 
presentation of the observations, this qualification prevails. No 
use will be made of additional qualifiers (e.g., "it appears...") as 
is the normal tendency when presenting data of this type. 

In performance of the lazy 8, positive pitch excursions exceed 
negative pitch excursions by at least 10 (Figure 34, a-d). This is 
not in accordance with the original maneuver analysis performed by ATC. 
Since the airspeed should vary between 200 and 100 knots, the probable 
reason for positive and negative pitch excursions being unequal is 
(a) the pilot attends to a'rspeed and not to pitch and (b) the aircraft 
accelerates and gains airspeed in a nose-down configuration faster than 
it decelerates and loses airspeed in a nose-up configuration. 

Generally, greater pitch excursions, both positive and negative, 
are experienced in the poorer performances. Also much more variance in 
pitch occurs in the second halt of the maneuver than in the first half 
for poor performances. This is probably due to the accumulated effect 
of errors on other parameters incurred in the first half (especially 
airspeed errors) and the ensuing attempt on the part of the pilot to 
"make up" for these errors in the second half. Pitch variance 
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I 12-19-69 

ENVO- 70 
,C1 LEFT) 

(12-19-69 EVNO 71 1 LEFT) 

The student pilot turns up almost to the north to do a lazi' 8 to the 
left. This time the student is starting out almost exclusivftly with 
pitch and very little bank change. Now with the pitch attitude of 
about 60®, he is rolling into the bank, slicing the nose down through 
after approximately 90"* of turn, down below the pojnt of the configuration* 
rolls out» makes a straight-ahead pullup by proceec'ing to crme 
through with approximately 200 knots. He is essen'-ially making the 
maneuver easier for himself by not changing all the parameters at once. 
That would have been an unsatisfactory lazy 8* 




1 1 1 -I 1 J 7 

1 20 . 00 -80. 00 -UC. 00 0 . 00 HO . 00 80. 00 1 20 . 00 
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Figure 40. Roll vs Pitch Plot 
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Figure 41. Airspeed Plot 
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noticeably increases as sk-Hl ratings decrease (e.g., as ratings proceed 
froif. e>:csllenc to unsatisfactory). 

As skill ratings decrease, there is a noticeable increase in the 
value of roll angle achieved at the points of local maximum and minimum 
pitch (Figure 54, c-h).Thu5, both roll and pitch exhibit wider 
exciirsions for lowar skilTed performances. 

Thnre is a very evident increase in the variance on airspeed 
Pleasures as. skill ratings decrease (Figure 35,^ a-d). Thfs is particularly 
obvious in discriminating fair from unsatisfactory performance. 
However, there is little change in the actual airspeed measures 
theR^seives, the only possible exception being in the fourth quarter of 
the maneuver where the measures are lower for unsatisfactory 
performances- 

There is an observable increase in the variance on altitude 
excursions as skil i ratings decrease, but this is true for only the 
first half of the maneiiver (Figure 35, e-n). In the second half, the 
sams tendency is observed only from fair to unsatisfactory degradation. 
Over the whole maneuver, an overall altitude gain ranging from 100 to 
1000 ft is usuaily obse^'ved, but there is no apparent correlation 
between altitude gained and skill level. 

The maximum positive and negative roll angles achieved in the 
maneuver show a definite increase in value as skill ratings vary from 
the excellent or good category to fair and unsatisfactory (Figure 36, 
a-b). Again, this supports previously discussed observations regarding 
greater parameter excursions in general as skill ratings decrease. The 
variance on maximum- roll angles shows an increase only from fair to 
unsatis factory perfcmances . 

There is a general decreasing trend in the time taken to perform 
the maneuver as skill ratings decrease, but there is no significant 
change in variance (Figure 36, c-e). This illustrates a tendency to 
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perform the maneuver faster (and with wider pitch and roll excursions) 
in the lower skill categories; however, time as a measure is not 
expected to be significant. 

Airspeed errors and the variances thereof show a noticeable increase 
as skill ratings decrease, particuiarly at the points of maximum 
positive or negative roll (i.e., at the end of the first and third 
quarters of the maneuver. Figure 37, a-h)-. 

Airspeed excursions show an obvious increase in variance as skill 
ratings decrease (Figure 38, a-d). This is particularly evident in 
the second half of the maneuver from the excellent/good to the fair/ 
unsatisfactory categories. 

The rate of change of airspeed with respect to time is generally 
lower in the first and fourth quarters than in the second and third 
.quarters (rates begin and end slowly with respect to the middle portions 
of the maneuver.) (Figure 38, e-h). The widest variances occur as well 
in the first and fourth quarters, particularly for unsatisfactory 
performances. 

Contrary to guidelines used by many instructors in teaching and 
performing the lazy 8, the value of airspeed at points of maximum 
positive and negative pitch does not appear to be 150 knots as judged 
by the PIT Instructor data. Observation of this came first from 
analysis of the debriefing plots and is substantiated by the mean-data 
presented in Figure 35 (a, b, c, and d). Following is a presentation 
of the first several lazy 8s flown by the PIT instructor and, where 
available, his recorded cotranents. In addition to providing a number 
of insights to the correct performance of the maneuver, this 
presentation will illustrate the errors incurred when the pilot 
attempted to use 150 knots as a check point; and the improvement of 
the performances when he apparently abandoned its use. 
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Performance 1 (11-18-69, event 4) 



Rating: Good 
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Pilot's Coirmentary: "As you know, the lazy 8 is a maximum performance 
maneuver where we will attempt to fly the airplane through a wide range 
of airspeeds, bank angles, and pitch attitudes. Power is 90%, our 
entry airspeed is 200 knots; speed brake is up. To accomplish the 
maneuver we will start a climbing turn very similar to a climb for a 
maximum performance climbing turn, planning to have our maximum pitch 
attitude after 45° of turn, or right about now. Airspeed should be 
approximately 150 knots. The nose begins to come down at this time. 
Bank is still increasing. Nose through the horizon after 90° of turn, 
down to its lowest point. You will notice that the airspeed was high 
during the point the nose came through the horizon, down to the nose 
lowest after 135° of turn. Back up to 200 knots and level flight now. 
Try to correct the mistake I made during the first half of that one by 
increasing my pitch more during the first half of this next maneuver and 
getting my airspeed down, planning to come through after 90° of turn. 
Airspeed still a^"t\le high, about 114 knots. Nose lowest after 135, 
back up to level flight after 180° of turn. End of maneuver. I would 
have graded that one about a low good or a high fair. Lets call it a 
good maneuver." 
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Performance 2 (11-18-69, event 5) Rating': Good 

-W 



AIRSPEED 

Pilot's Commentary: "Ready to start into lazy 8 number 2. Continuing 
the maneuver, trying to adjust my airspeed this time so that it comes 
down to 100 knots, and- you will notice that I did not get it. We will 
come" back to straight and level flight, 200 knots, and I will again 
try to get the pitch up further so that I get down to 100 knots. And 
I am still coming through with 112. Now the reason I am grading this 
good is that I have the basic nose track correct. However I am not 
hitting the proper parameters. This maneuver is complete and I would 
have graded it good." 
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.Pilot's Commentary: "Okay, I will again attempt to correct. Apparently 
the cooler day has given me a good deal more aircraft performance than 
I was expecting. I am starting the nose-up at a higher rate of change 
than I have been doing, getting maximum pitch after 45*^. Bank 
continuing to increase. Nose-down through the horizon after 90^ of 
turn, airspeed 98 knots. At its lowest after 135^ of turn. I am not 
getting the nose-down low enough; as a result I am coming back through 
with a little lower airspeed on this one... 95 knots at its lowest; now 
let us go down a little lower as the bank decreases, planning to come 
back to level flight again at 200 knots and straight and level flight. • 
End of lazy 8 number 3. I would have graded that one a high good or 
low excellent. Call it a good. I'd like to get just one excellent 
while we are out here today!" 



Performance 4 (11-18-69. event 7) 



Rating: Excellent 
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Pilot's Commentary: None recorded 
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Performance 5 (11-18-69, event 13) 



Rating: Good 
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Pilot's Commentary: "Starting our pullup...get the pitch attitude to 
its highest point at 45° of turn; and I'm through with high airspeed 
again, try to correct it on the second half of this maneuver, nose 
lowest after 135 with approximately 150 knots. Again I will attempt 
to correct by pulling the nos.e up at a faster rate to begin with, 
airspeed at its lowest after 90° of turn, pitch at its lowest on 45°, 
back to straight and level after 180?. That one I would have graded 
•good. The reason for the good is a low airspeed during the first half 
of the maneuver. The second half I thought was a pretty good maneuver." 

1 

(2) Simplified Combination Error Measure 

Based on the foregoing observations and analysis data, a 
simple combination error measure was derived and computed for each 
performance. The measure is based on criteria for roll, pitch, and 
airspeed determined from the representative data. The criteria are: 



^ = First max. positive pitch" 40° 

= First min. negative pitch «_26° 
= Second max. positive pitch = 40° 
= Second min. negative pitch = -26° 
^5-. 6. 7. 8 2,'3,4 = 45° 

^9, 10, 11, 12 = Airspeed at 3, 4 = ""Sa knots 



M 
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The combined measure is 

\z 

where = criterion M. 
M. 1 

and recorded M. . 

M. 1 

Figure 43 shows this computed measure for the 47 PIT instructor lazy 8s. 

Note that the measure easily and clearly discriminates between 
excellent and fair levels of performance. Fair versus unsatisfactory 
is also discriminated well, the only exception being a performance that 
was judged to be unsa .isfactory by the Instructor but which was 
commented upon as being "maybe a low fair" by the same instructor. 
Similarly, other performances whose assigned ratings appear questionable 
by standards of the measure were found to have associated instructor 
comments supporting the measure's validity (Figure 43). 

This measure alone accounts for'67% of the varia' 'n Instructor 
ratings, considering all performances. If ratings for the three 
performances footnoted in Figure 43 are changed as dictated by the 
instructor's recorded comments, the measure would account for 72% of 
the variance. 

In light of the simplicity of the measure (sampling three variables 
at four discrete points in the maneuver) and the fact that absolutely no 
weighting was performed in its computation (straight error sum), the 
results are quite remarkable. It is hypothesized that use of an 
integrated error measure on the roll/pitch relationship and the 
employment of linear weighting would easily improve the measure 20 to 
2555, as evaluated by its correlation with subjective ratings. 
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Figure 43^ Combination Error Measure for 47 PIT Instructor Lazy 8 
Performances 
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(3) Debriefing Plots . 

Figure 44 shows a smoothed mean roll-pitch profile for the 
PIT instructor excellent left performances. Also shown for 'Comparison 
is an example of unsatisfactory performance as it might be overlaid 
and annotated in a finished debriefing plot. 

b. AFHRL and ATC Instructors 

Sixteen Lazy 8 performances by four different instructor pilots 
were analyzed. , Most of these ware performed during student-instruction 
to demonstrate proper performance of the maneuver; The performances 
were rated by the IP's and are distributed across the rating categories 
as shown in Figure 45; some performances have no rating associated with 
them. 

With so few samples per IP, little could be gained by analysis of 
mean measures versus rating category or by correlations of measures with 
subjective ratings. It is of interest, however, to examine intra- ' 
and inter-instructor variance and technique. For this purpose, 
thirteen measures (numbers 1-12 and 27 in Table XVII) were selected 
for analysis. 

Since only one sample was obtained for one of the four instructors, 
he was omitted from the analysis. Included, then, were three AFHRL 
or ATC IPs and the PIT IP, the latter's performances being chosen as 
all those rated excellent. Table XVIII shows the average standard 
deviation for each measure, taken across all 4 pilots; and the 
standard deviation of the average measures. The former provides some 
indication of intra-instructor variance; the latter provides 
indication of inter-instructor variance. 

For most measures, the amount of V'iriation between the average 
performances of the IPs is roughly equivalent to the amount of variation 
within a given IP. To interpret the meaning of these statements, we 
shall use the example of measure number 9, the airspeed sampled in the 
third quarter of the maneuver at the point of maximum positive pitch. 
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Figure 44. Sample Annotated Debriefing Plot 
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TABLE XVI 1 I 

INDICANTS OF INTRA- AND INTER- INSTRUCTOR VARIANCE 
ON LAZY 8 PERFORfWNCES 



Pleasure 




Intra- Instructor* ' 
variance ma. 


* 

I n te r- 1 n s true tor** 
Variance Ind. 




Wan 


£i 
u 


1 


2. Roll 


Deg 


5 


5 


3* Airspeed 


Kts 


7 


6 


4. 1st min» pitch 


Deg 


4 


5 


5. Roll 


Deg 


5 


7 


6. Airspeed 


Kts 


10 


7 


7* 2nd max. pitch 


Deg 


4 


1 


8. Roll 


Deg 


6 


5 


9. Airspeed 


Kts 


9 


9 


10. 2nd min. pitch 


Deg 


4 


6 


n. Roll 


peg 


5 


7 


12. Airspeed 


Kts 


8 


8 


13. Sum airsp. errs 


Kts 


10 


4 



Average standard deviation for 4 IPs 

Standard deviation of averages of measures for 4 IPs 
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The statement implies the possibility that (1) a given IP*s 
demonstration of the maneuver could be expected to result in an airspeed 
variation (on this measure) of 18 knots; and (2) if two different 
IPs demonstrated the maneuver, the variation could be as much as 27 ■ 
knots, considering all performances of both IPs. 

Measures 1 and 7, the maximum positive pitch values in the 1st and 
3rd quarters, show very little inter-instructor variance. Although 
each IP could be expected to vary +4 to +6 degrees, the instructors are 
consistent in that their average performances would probably vary by only 

Similarly, measure 13, the sum of 5 airspeed errors, shows 
consistency across instriTctdrs^ insofar as average performances are ' 
concerned. 

c. Students 

Forty-two performances of 16 different student pilots were 
analyzed, with the performances rated by the accompanying IP and 
distributed across rating categories as shown inPigure 46. Table XIX 
lists general data on the students comprising the sampling population. 
Also shown in Table XIX are codes representing which of two IPs flew 
with and rated each student. 

Figures 47 to 52 illustrate plots of mean and standard deviations 
for the 41 measures. Correlations between measures and subjective 
ratings for all student performances are provided in Table XX. 
Debriefing plots were also generated for use in the analysis. 

Roll and pitch excursions and variances increase slightly as skill 
ratings decrease. However, the amount of increase from fair to 
unsatisfactory is noticeably less than for the PIT instructor data. 
This could be due to different rating-standards between IPs. 

Airspeed values at points of maximum pitch excursion are noticeably 
higher for students than for the PIT IP. Variances in the 
unsatisfactory performances are less. 
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Figure 52. Time Measures for Student Lazy 8's [Mean + 1 <r] 



196 



AFHRL-TR-72-6 



■ TABLE XX 



CORRELATIONS BETWEEN MEASURES AND SUBJECTIVE RATINGS 
FOR STUDENT LAZY 8s 



Measure Number 



Correlation Coefs . 



All 


Right 


Left 


0.05 


0.48 


-0.12 


t\ AO 

0«02 


0.30 


-0.03 


A OO 

-0.Z8 


0.02 


-0.38 


A 0"7 

0.27 


0.02 


0.44** 


A m 

-0.21 


-0.04 


-0.32 


-0.1/ 


-0.60** 


-0.02 


A AC 

-0.25 


-0.12 


-0.30 


A ^ *V 

-0.1/ 


-0.24 


-0.16 


A AA 

-0.20 


-0.44 


-0.11 


A n 1 

-0.21 


-0.54** 


-0.08 


-0.07 


-0.15 


-0.05 


A A il 

-0.04 


-0.10 


-0.02 


A AA 

0.29 


0.20 


0.41** 


0.31** 


0.33 


0.33 


0.27 


-0.02 


0.39** 


0.26 


0.12 


0.32 


-0.39** 


-0.45 


-0.40** 


0.21 


0.21 


0.23 


0.02 


0.45 


-0.12 


0.07 


-0.22 


0.21 


0.13 


0.20 


0.10 


0.03 


0.01 


0.04 


-0.19 


-0.30 


-0.15 


-0.16 


-0.38 


-0.06 


-0.15 


-0.11 


-0.18 


-0.14 


0.03 


0.25 


-0.24 


-0.34 


-0.20 


-0.19 


-0.42 


-0.11 


-0.27 


-0.32 


-0.25 


0.35** , 


0.46 


0.33 


0.09 


0.26 


-0.00 


-0.16 


-0.08 


-0.22 


-0.06 


0.15 


-0.19 


0.25 


0.28 


0.24 


0.05 


-0.07 


0.11 


-0.23 


0.10 


-0.44** 


-0.06 


0.09 


-0.15 


-0.05 


0.34 


-0.16 


0.10 


0.36 


-0.11 


0.10 


-0.24 


0.32 


0.00 


-0.06 ■ 


0.04 



1. 

2. 
J. 
4. 
5. 
6. 
7. 
8. 
9. 
10;. 
11. 
12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 
31. 
32. 
33. 
34. 
35. 
36. 
37. 
38. 
39. 
40. 
41. 



1 Pitch 

1 Pitch 

2 Pitch 
2 Pitch 

.(1 



1! 



Max. 
Hin. 
Max. 
Hin. 
Roll 
Roll 
Roll 
Roll 

Airspeed 
Airspeed 
Airspeed ( 
Airspeed ( 
Altitude ( 
Altitude ( 
Altitude ( 
Altitude ( 
Max. Roll 
Hin. Roll 
Time (half 
Time (half 
Total Time 
Airspeed Error 1 
Airspeed Error 2 
Airspeed Error 3 
Airspeed Error 4 
Airspeed Error 5 
Summary (1-5) 
Summary (1-3) 
Summary (3-5) 
Delta Airspeed 
Delta Airspeed 
Delta Airspeed 
Delta Airspeed 
Airspeed Rate 
Airspeed Rate 
Airspeed Rate 
Airspeed Rate 
Time (1) 
Time (2) 
Time 
Time 



(1) 

a) 

(3) 
(4) 



(3) 
(4) 



(1) 

(2) 
(3) 
(4) 
(1) 
(2) 
(3) 
(4) 



* Significant to 0.01 level 
** Significant to 0.05 level 
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Altitude excursions for stu(jents are on the order of 300 and 600 ft 
less (In first and second halves of maneuver, respectively) than for 
the PIT IP. This is probably due to the varying environmental conditions 
(and, therefore, aircraft performance) In which the sorties were 
flown. The AFHRL and ATC IP data shows altitude excursions similar to 
those of the students, suggesting that It Is not due to differences 
between students and IPs as classes of subjects* 

Maximum roll angles attained In the maneuver have greater variance 
across all skill categories for students than for the PIT IP. Similarly, 
the total time to perform the maneuver, while having about the same 
mean, has much wider variances. 

Unlike the PIT case, airspeed errors appear to have no relationship 
to skill category for the student data (Figure 50). It Is strongly 
suspected that this Is due to a difference In rating-standards among 
IPs, I.e., a difference in the assumed Importance of airspeed In 
grading the maneuver. This Is substantiated later In this Section 
where we examine trends of measures for an individual student; It also 
signals clearly one of the shortcomings of using IP ratings as a guide 
In the development of measures. 

Another major difference between the student and PIT data is the 
airspeed vaiue at the points of maximum pitch excursion. Recall that 
the PIT IP at first was striving for 150 knots at these points and was 
forced to reduce this value to about 133 knots in order to accomplish 
the maneuver correctly. However, 150 knots appears to work 
satisfactorily as judged by the student data. It is suspected that 
differences in aircraft performance in different environmental conditions 
is the reason* 
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Correlations between measures and subjective ratings for students 
are, in general, insignificant. This is in direct contra'it to the 
PIT case, where a number of significant coefficients were found. 
Again, this appears to be due to the IP's rating techniques for the 
student data, and this will be further substantiated later in this 
Section* 

The combination. error measure that discriminated performances so 
well for the PIT data (Figure 43) was computed for the student data. 
The results are shown in Figure 53. The complete lack of discrimination 
is evident* - 

d. Within-Subject Sampling as a Basis for 
Measurement Development 

Until now, we have referenced instructor ratings as a guideline for 
the development of measures and for demonstrating their face-validity. 
This approach, as the sole approach, has serious shortcomings because 
it is based on the assumptions that (1) all instructors or raters 
apply the same standards and, for the most part at least, are 
consistent and reliable in their use of the (four) rating categories; 
and (2) the standards that are applied are valid. The authors 
contend that neither assumption is true. 

This is not to say that the use of instructor ratings as initial 
guidelines in the development of measures is not valuable. A great 
deal of insight to the measurement of maneuvers can very definitely be 
attained by examination of subjective ratings. However, the use of 
subjective ratings in the-development of objective measures is in itself 
a dichotomy, and such use must be made with caution and with the 
understanding that both reliable standards and rating-standardization 
can be expected to be lacking in the subjective system. 
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Another approach is to accomplish measurement development and 
(equally important) to validate measures us.ing within-subject sampling. 
With this approach, the major assumption is that learning occurs with 
time and practice, of a maneuver. Individual measures that are developed 
should reflect all or a part of that learning through their trends from 
day No. 1 of instruction on a maneuver through the final day of training 
for each student. 

In the present study, this approach was originally a part of the 
experimental design; however, it was impossible to apply in toto due 
to difficulties encountered in collecting a lot of data per student for 
all students sampled. It was possible, however, to attain sufficient 
data for one student to illustrate the approach. These results will be 
discussed next. 

(1) Example for a Single Student 

For student number 6 (Table XIX), eight performances of the 
lazy 8 were recorded during three different sorties. The sorties were 
separated by 1.5 and 17.2 flight hours and by 2 and 19 days, respectively. 
For reference, the performances are numbered 1 to 8, with 1-3 flown on 
the first sortie recorded, 4-5 on the second sortie, and 6-8 on the 
third sortie. (In order, the sorties were rated F, F, F, F, F, G, G, F.) 

Figures 54 to 59 show each of the individual measures for the 
8 performances of this student. Figure 60 shows the combination error 
measure for this student and for a second student (no.. 14) for which 
6 performances were recorded on 2 separate sorties. One measure whose 
trends are more obvious than others is the change in airspeed in the 
4 quarters of the maneuver (Figure 58, a-d). Assuming the ATC 
excursion limits of lOO to 200 knots is correct, this measure should 
trend to 100 knots. The plots demonstrate this clearly. Also, the' 
airspeed error measures (Figure 57) show a distinct decrease in error 
from early samples to later samples. 
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Figure 59. Time Measures for Single Student Performance of the Lazy 8 
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Also relevant is the combination error measure of Figure 60. 
Although there was little if any correlation between this measure and the 
subjective ratings for all students (Figure 53), the trends of this 
measure across single student sorties show definite trends toward a 
decrease in error, as would be expected. On the Figure 60 plot, the 
measure is also shown for students numbers 6 and 14. Both students* • 
data substantiates the validity of the measure despite its lack of 
correlation with subjective ratings. 

e. Comparison of Instructor Rating Standards 

Because of the low correlations between measures and subjective 
ratings for the student data (Table XX), inconsistency between the 
two involved IPs is suspect. To pursue this idea a little further, 
separate correlations for each IP wer6 computed and are shown in 
Table XXI along with those for both IPs together. 

The number of significant correlations (0/05 level or better) does 
not increase appreciably considering one IP at a time. However, some 
significant differences between correlations for the two IPs are noted. 
For IP-1, a significant positive correlation exists for the first 
maximum positive pitch, whereas only a small correlation (0.08) is 
shown for IP-2. Also, for the value of roll at the first minimum 
negative pitch, IP-1 shows a correlation of opposite sign and roughly 
equal level of significance to that of IP-2. 

For altitude variations, correlations for IP-2 are consistently 
higher than for IP-1. At the point of first maximum positive pitch, 
for example, correlations were 0.66 and 0.16 for IP-2 and IP-1, 
respectively. 

For time measures, correlations for the two IPs are generally small 
but of opposite signs. The most significant difference is for time to 
perform the second quarter of the maneuver, where the correlations are 
-0.62 and 0.35 for IP-2 and IP-1 respectively. 
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TABLE XXI 



CORRELATIONS BETWEEN IP RATINGS AND MEASURES 



Measure Number 


IP-1 

n=31 


IP-2 
n=ll 


Both IPs 
n=42 


1 • 


Max. 1 Pitch (1) 


0.37** 


0.08 


0.05 


o 


Min. 1 Pitch (2) 


-0.10 


^0.27 


0.02 


0. 


Max. 2 Pitch (3) 


-0.11 


-0.27 


-0.28 


4. 


Min. 2 Pitch (4) 


-0.09 


0.37 


0.27 


5. 


Roll (1) 




-0.14 


-0.01 


-0.21 


6. 


Roll (2) 




-0.28 


0.33 


-0.17 


7. 


Roll (3) 




-0.34 


-0.05 


-0.25 


8. 


Roll (4) 


(1) 


0.00 


0.08 


-0.17 


9. 


Airspeed 


-0.25 


-0.40 


-0.20 


lU. 


Ai rspeed 


(2) 


-0.37** 


-0.23 


-0.2i 


n . 


Ai rspeed 


(3) 


-0.14 


-0.36 


-0.07 


12. 


Ai rspeed 


(4) 


-0.06 


-0.25 


-0.04 


13. 


Altitude 


(1) 


0.16 


0.66** 


0.29 


14. 


Altitude 


(2) 


0.27 


0.48 


0.31** 


15. 


Altitude 


(3) 


0.19 


0.54 


0.27 


16. 


Altitude 


(4) 


0.16 


0.60 


0.26 


17. 


Max. Roll 




-0.31 


-0.26 


-0.39** 


lo. 


Min. Roll 




0.03 


-0.14 


0.21 


19. 


Time (half 1) 


0.29 


-0.48 


0.02 


20. 


Time (half 2) 


-0.02 


0.19 


0.07 


21. 


Total Time 


0.27 


-0.25 


0.13 


22. 


Airspeed Error 1 


0.19 


-0.22 


0.03 


23. 


Airspeed Error 2 


-0.35 


-0.27 


-0.19 


• 24. 


Airspeed Error 3 


-0.25 


-0.07 


-0.16 


25. 


Airspeed Error 4 


-0.25 


.0.74** 


-0.15 


26. 


Airspeed Error 5 


-0.03 


-0.30 


-0.14 


27. 


Summary 


(1-5) 


-0.34 


-0.44 


-0.24 


28. 


Summary 




-0.30 


-0.25 


-0.19 


29. 


Summary 




-0.37** 


-0.46 


-0.27 


30. 


Delta Airspeed (1) 


0.48* 


0.45 


0.35**. 


31. 


Delta Airspeed (2) 


0.24 


-0.01 


0.09 


32. 


Delta Airspeed (3) 


-0.01 


-0.30 


-0.16 


33. 


Delta Airspeed (4) 


0.16 


-0.20 


-0.06 


34. 


Airspeed Rate (1) 


0.38** 


0.48 


0.25 


35. 


Airspeed Rate (2) 


-0.06 


0.63** 


0.05 


36. 


Airspeed Rate (3) 


-0.03 


-0.36 


-0.23 


37. 


Airspeed Rate (4) 


0.14 


-0.05 


-0.06 


38. 


Time (1) 




0.01 


-0.35 


-0.05 


39. 


Time (2) 




0.35 


-0.62** 


0.10 


40. 


Time (3) 




0.02 


0.32 


0.10 


41. 


Time (4) 




-0.08 


-0.04 


0.00 



* Significertt to 0.01 level 
**Significant to 0.05 level 
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These and other differences between the signs and magnitudes of 
the correlations substantiate the questionab'(e degree of consistency 
between the two IPs insofar as ratings are concerned. This small sample 
of ratings, particularly for IP-2, cannot be expected to provide a 
basis for proof-positive statements regarding rating consistency, but 
it certainly warrants raising a question and supports the contention that 
IP ratings cannot be used as the sole basis for measurement development* 

f. Suiiimary and Results for Lazy 8 Measurement 

Based on the foregoing analysis of lazy 8 data from three 
different sources (instructor of instructor-pilots, standard instructor 
pilots, and students), the following recommendations are made for 
measurement of this maneuver: 

A summary error measure should be computed, using parameters of 
roll, pitch, and airspeed. The measure used in^this study is 

where M. and C. are the recorded individual measures and the criteria 
for pitch, roll, and airspeed sampled at the four points of local 
pitch extremes. 



An improved error measure should be computed and evaluated based on 
a continuous comparison between roll/pitch measures and criteria. This 
can be accomplished using the formula 



Ms / / |a - C| dr dp 



where A and C are curves for actual (recorded) and criterion roll/pitch 
relationship, p is pitch, and r is roll. 



ERIC 
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Debriefing plots showing roll vs pitch and airspeed should be 
generated and annotated. On the plots, diagnostic aids should be 
printed in the form of individual measures and comments. Examples of 
such plots are shown in Appendix XVI. 

Measures should be validated using repeated samples per student. 
Little reliance, except for initial guidance, should be placed in 
correlations between IP ratings and measures. 

The criteria computed from the PIT IP data appear valid. However 
a larger sample of data is required to ascertain true validity. (This 
may result in slight alteration of the parameter criterion values.) 

Environmental conditions (temperature and humidity) that 
significantly affect aircraft performance should be considered in the 
development of quantitative criteria. 

2. BARREL ROLL 

a. Student Data 

Forty-eight student performances of the barrel roll were 
analyzed. The performances were rated by the accompanying IP and are 
distributed across skill categories as shown in Figure 61. Figures 62 
to 67 show the plots of mean and standard deviations for the 47 measures. 
Correlations with subjective ratings are provided in Table XXII. 

Most of the student performances {75%) were judged in the "fair" 
category. This of course must influence our interpretation and reliance 
upon data trends across skill categories as well as the correlations. 
So although some insights to barrel roll measurement can be determined 
using the existing data, tests will be necessary in future efforts 
using (1) a better data sample with respect to each skill category 
and (2) more samples per student. 
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TABLE XXII 

CORRELATIONS BETWEEN MEASURES AND SUBJECTIVE RATINGS 
FOR STUDENT BARREL ROLLS 







Correlation Coefficients 




Measure 


All (N=48) 


Left (N=43) 


1 * 


Synmetry (1-4) 


-0.05 


-0.05 


2. 


Symmetry (2-3) 


-0.15 


-0.16 


3. 


Symmetry (Halves) 


-0.32* 


-0.32* 


4. 


Circle 1 


-0.27 


-0.27 


5. 


Circle 2 


-0.31* 


-0.31* 


5. 


Circle All 


-0.31* 


-0.31* 


7. 


RR Correlation All 


0.24 


0.24 


8. 


PR Correlation All 


0.11 


0.14 


9. 


g Correlation All 


-0.04 


-0.06 


10. 


RR Correlation R>45 


-0.31* 


-0.33* 


11. 


PR Correlation R>45 


-0.01 


0.01 


12. 


g Correlation R > 45 


-0.06 


-0.11 


13. 


Max g 1 


0.17 


0.18 


14. 


Max g 2 


0.19 


0.20 


15. 


Min g 


0.18 


0.19 


16. 


Roll Max Pitch 


0.21 


0.22 


V,. 


Roll Min Pitch 


0.15 


0.15 


18. 


Max RR 


-0.13 


-0.15 


19. 


Max PR 


0.11 


0.12 


20. 


Min PR 


-0.04 


-0.04 


21. 


Time (Total) 


-0.01 


-0.00 


22. 


Time 1 


-0.19 


-0.19 


23. 


Time 2 


0.18 


0.18 
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TABLE XXII (Concluded) 
CORRELATIONS BETWEEN MEASURES AND SUBJECTIVE RATINGS 
FOR STUDENT BARREL ROLLS 











Correlation Coefficients 




Measure 




All (N=48) 


Left ~(N=43) 


24. 


D 

r 


IK - 


10) 


0.22 


0.24 


25. 


D 

r 


Id - 


50) 


0.26 


0.27 


26. 


D 

r 


to - 


90) 


0.28 


0.29 


27. 


D 

r 


to - 


140) 


0.23 


0.24 


28. 


D 

r 


IK - 


180) 


0.24 


0.26 


29. 


P 


(R = 


140) 


0.09 


0.09 


30. 


P 


(R = 


90) 


0.04 


0.04 


31. 


P 


(R = 


50) 


0.10 


0.10 


32. 


P 


(R = 


10) 


0.22 


0.22 


33. 


A- 


ALT 


(R = 10) 


0.02 


0.03 


34. 


A- 


ALT 


(R = 60) 


0.04 


0.05 


35. 


A- 


ALT 


(R = 120) 


0.10 


0.10 


36. 


A- 


ALT 


(R = 180) 


0.11 


0.13 


37. 


A- 


ALT 


(R = 120) 


0.05 


0.07 


38. 


A- 


ALT 


(R = 60) 


-0.01 


0.00 


39. 


A- 


ALT 


(R = 10) 


-0.04 


-0.04 


40. 


A- 


ARSP 


(R = 10) 


-0.08 


-0.09 


41. 


A- 


ARSP 


(R = 60) 


-0.06 


-0.05 


42. 


A- 


ARSP 


(R = 120) 


-0.13 


-0.13 


43. 


A- 


ARSP 


(R = 180) 


-0.15 


-0.17 


44. 


A- 


ARSP 


(R = 120) 


-0.06 


-0.10 


45. 


A- 


ARSP 


(R = 60) 


-0.02 


-0.04 


45. 


A- 


ARSP 


(R = 10) 


0.14 


0.14 



*Significant to 0.05 level. 
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There is a distinct increase in variance as skill ratings decrease 
in the symmetry measure on quarters 2 and 3. No significant increase is 
noted for quarters 1 and 4, however. This indicates that more variance 
in the roll/pitch relationship is exhibited in the inverted attitude, 
as may be expected. A distinct increase in variance is also noted for 
halves 1 and 2 as skill ratings vary from fair to unsatisfactory. 

Circle measures, which are error measures, increase in value as well 
as variance as skill ratings decrease. From this data and from the 
debriefing plots, it is postulated that the circle measure will prove 
to be one of the best single indicies of performance skill. 

Of the constancy measures on roll rate, pitch rate, and normal 
acceleration, only the roll rate measure for jroll | > 45 appears 
significant from the standpoint of significant correlations. However, 
the plot shows that as skill ratings decrease, the correlation 
increases toward 1.0, indicating less variance in roll rate itself. 
This is the opposite from that which was eJfpected based on the maneuver 
analy..- and requires further investigation in future efforts. In 
addition, variance of the correlation decreases as skill ratings 
decrease, though ^ne would expect an increase. 

Maximum 6 measures show a slight increase as skill ratings vary from 
good to fair, but a decrease in value and increase in variance with 
reduction to unsatisfactory. This may indicate that max. 6 measures 
may discriminate higher-skill performances better than lower-skill ones; 
or that lower-skill performance patterns are typically flatter on top and 
dished-out on the bottom, resulting in much less normal acceleration on 
the average. Minimum G measures show a decrease from fair to 
unsatisfactory, indicating the known tendency to "get light" on top 
when unskilled in performance of this maneuver. 
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Roll at maximum pitch is approximately 60 to 62^ for good 
performances and decreases noticeably as skill ratings decrease (with 
an accompanying increase in variance). Th*s suggests a tend^^ncy (as 
skill degrades) to pitch-up, with relatively litcle roll .hen roll 
to the inverted position. This tendency can also be clearly seen in 
the debriefing plots and supports the validity of the circle measures, 
which are based on a criterion of evenly and constantly changing roll 
and pitch. A surprising point regarding roll at maximum pitch i$ that 
theoretically it should be 90^ to maintain a constant offset angle from 
the reference point. However, none of the highly skille'J performances, 
including those of instructors, exhibit this. It appears that ^-he 
requirement for a constant offset angle may be an unrealistic c-^"^ *:er . Dn, 
both from the standpoint of human ability, and perhaps, aircraf* 

o 

performance ability. 

The pitch measures at various values of roll are most easily ana'^yzed 
via the plot of Figure 68. The unsatisfactory performances exhibit a 
smaller maximum positive pitch angle and pitch reduces to zero before 
roll has reached 180^. All performances exhibit a linear as opposed to 
a smooth, curvilinear roll/pitch relationship in the second quarter of 
the maneuver. 

Figures 69 and 70 show similar plots for altitude and airspeed 
excursions. Little, if any, relevant measurement information can b** 
expected to exist in these measures. 

The correlations between measures and subjective ratings (Table 
XXII) indicate only four significant measures. Although any number 
of alternative combinatory measures could be postulated, the data 
are insufficient to permit validation, so none were computed for the 
barrel roll in this study. 



Plans exist to test the realism of this criterion using a flight 
simulator. We attempted to test it in the aircraft, but despite 
specific attempts on the part of the pilots, they were unable to achieve 
90^ roll at maximum pitch and still complete the maneuver satisfactorily 
in all other respects. 
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PIT Instructor Dats 

Due to time limitations, barrel roll measures were not computed 
for the PIT Instructor data. However, debriefing plots were generated 
for 41 performances, and their analysis gives additional insights to 
the measurement of this maneuver. Several plots are nresented in 
Appendix XVIII, along with the transcribed pilot coioments. 

It can be seen, in viewing the plots, that the roll/pitch 
relationship is very relevant to measurement. This supoorts the trends • 
indicated in the student data. Many of the conditions described in 
pilots' comments are clearly demonstrated by the rolVpitch plot, e.g., 
dishing out on the bottom, excessive pitch without sufficient roll, 
"flat" portions of the maneuver, and too much initial back pressure. 

c. Summary 

Unfortunately, not nearly enough barrel roll data was collected 
to form supportable recommendations about measurement of this maneuver. 
The major deficit is successive samples per student needed to develop 
and validate measures. Based on the data collected, it is theorized 
that the following measures" are valid and should be investigated further: 

1. Roll/Pitch Circle Measures 

2. Maximum and Minimum 6's 

3. Constancy of Roll Rate 

4. Symmetry Measures 

Further studies should also address the questions raised earlier 
regarding roll value at maximum pitch, and whethe** or not maintenance 
of a constant offset angle is a realisticcriterion. Further, the 
autnors found a distinct difference be^^-ween instructors in their method 
of performing the barrel roll insofar as g control Is concerned. 
Realistic criteria on g's need to be determined. 
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Measurement-wise, it is obvious that less was accomplished on the 

barrel roll than on the lazy 8. This was due primarily to lack of 

sufficient data; but contributing factors are (1) time limitations 
on the study, with more emphasis having been placed on the lazy 8, and 

(2) an apparent inconsistency in criteria for the barrel roll, and 

subsequently, a great necessity for computing standards (which has not 
yet been accomplished). 

3. OTHER MANEUVERS: TYPICAL DATA 

Some representative data were plotted for maneuvers other than the 
lazy 8 and barrel roll. This data will be used to support follow-on 
studies in this subject area. As a matter of interest and documentation, 
typical plots of roll^ pitch, airspeed and altitude are presented for 
several of these other maneuvers in Figures 71 through 76. 
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SECTION VIII 
DISCUSSION AND ADDITIONAL REMARKS 

It is fortunate that at the onset of this program the authors were a 
little naive about the problems and difficulties that plague collectors 
of in-flight data. Otherwise, that which has resulted in an extremely 
worthwhile and timely effort may have been put off had there baen more 
realistic original estimates of the time and level-of-effort required to 
complete the program. As it turned out, only 30 to 40% of the total 
effort (manhours) expended was actually devoted to the central issue, 
e.g., development of measurement techniques for two representative 
jmaneuvers; the bulk of the effort was devoted to establishing the 
machinery, so to speak, for data collection, reduction, calibration, 
and analysis. In a way, the results and benefits of the effort are 
therefore actually greater than originally anticipated, because in 
addition to accomplishing the major goals related to feasibility of 
quantitative measurement, (i.e. , knowing what to do), the authors 
have compiled an impressive list of "what not to do" in the future. 
So in addition to providing a summary of central results, this Section 
will be devoted to some of the major problems encountered (and lessons 
learned) in accomplishing an effort of this type. 

1 . PROBLEMS 

It is not easy to obtain good in-flight performance data and reduce it 
to a form suitable for analysis. Recognition of this, and provision for 
sufficient personnel to handle problems as they arise, is necessary to a 
successful conduct of related studies. In the study being reported, the 
limited availability of equipment and support personnel made it necessary 
to obtain the needed support from two different data processing 
installations. This complicated the already difficult job by requiring 
inter-installation coordination and by creating additional problems 
through the use of different tape units for producing and reading data. 
In addition, control of personnel was not possible, and several 
different programmers were assigned to the program over its tenure. 

235 



AFHRL-TR--72-6 



This required almost continual education of these new people regarding 
data formats and program objectives. Finally, no control existed over 
the utilization of data processing equipment, and turn around time from 
flight to calibrated data was considerably longer than it should have 
been for efficient operation due to higher priority programs competing 
for use of the equipment. 

The in-flight data acquisition equipment represented no exception to 
"Murphy's Law," particularly because it was largely (off-the-shelf) 
used equipment. Partway through the program problems arose with the 
heading transducer that were never completely rectified despite several 
recalibrations. (Later, it was determined that a new transducer is 
required.) Other equipment malfunctions occurred from time to time, 
seriously delaying data collection schedules and validating the 
importance and necessity of establishing a rigorous periodic recalibration 
and preventive maintenance program for the airborne equipment. This 
would hopefully minimize the requirement for the unscheduled, on-call 
type of maintenance that upsets schedules. 

Operational problems also confounded the problem. Despite planning- 
precautions, flight/line personnel often failed to clean the recorder 
heads as required, Smd data from several sorties were lost. This 
occurred most often during the last several weeks of off-site data 
collection and was in part the reason why sufficient validation data was 
not successfully collected. Another operational problem regarded in- 
flight use of the recorder through cockpit controls. Each instructor 
was briefed on recorder operation, but evidently the briefings were not 
thorough enough. On several successive sorties, the participating IP 
turned the recorder off between maneuvers, and this resulted in losing 
some data at the end or beginning of maneuvers. It also caused "glitches" 
in the data at the time the recorder was turned off or on and destroyed 
the continuity of the time-count. 
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It is also important, in projecting schedules for studies like this, 
to consider not only anticipated aircraft maintenance downtime, but 
special requirements for modifications and inspections. For example, 
data collection was interrupted on two separate occasions for flap-hinge 
mods and wing spar inspections. These sound innocent enough, but in 
the case of this study the aircraft was bailed to Flight Test and they, 
therefore, accomplished the mods. Scheduling of hangar space and 
personnel to accomplish the work was perhaps more of a problem' than it 
would be with a regular training aircraft in the ATC fleet. 

For student data collection, the arrangement with ATC included 
assurance that normal schedules and curricula would not be interfered 
with. This made collection of large quantities of data per student 
- per maneuver difficult. 



The effort was conducted 100% in-house and necessarily attempts 
were made to minimize any direct costs. At the onset of the program, 
some surplus recorders were obtained. These proved unusable. The 
recorder and instrumentation gear finally installed was used equipment, 
not in itself bad, but necessitating some additional test and parts 
replacement early in the program. ' 

The effort was largely prototype and investigatory in nature and 
considerable effort was expended on alternative solutions to problems as 
they occurred: 

2. EULER ANGLES COMPUTATION 

One small side-effort concerned the computation of Euler angles from 
recorded rates. This was investigated for three reasons: (1) It 
would provide an additional check on the relative accuracies with which 
rates and angles are recorded, (2) It would allow angles through all 
attitudes to be generated without necessitating all -altitude roll and 
pitch transducers, (3) It would provide the only good test conceivable 
on the accuracy of rate information. Programs were written to compute 
angles from rates. Results showed that recorded rate information was 
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too noisy to produce good results and the effort was abandoned to the 
priority of other problems. 

3. MODELING OF NORMATIVE DATA 

Another side-effort concerned taking a closer look at computation 
of norms or standards. Although used to some extent in this study, 
mean-performances are not believed to be infallible representations of 
standards, any more than the mean Is always a good representation of 
any data. 

In studying the formal description and ATC criteria for the lazy 8 
maneuver, the idea occurred that functions representing both roll and 
pitch versus degrees-of-turn may be easily approximated using 
trigonometric functions. For example roll angle increases to a maximum 
at turn = 90°, decreases to zero at turn 180°; then repeats this 
pattern. In simplest form, we could represent this motion by a sine 
wave multiplied by the maximum roll angle attained in the maneuver 
(80 - 9^/"). 

Pitch behaves similarly but has an amplitude equal to the largest 
pitch angle attained in the maneuver and a frequency equal to twice that 
of the r '1 function. 

An harmonic analysis of a function is a truncated Fourier Series 
approximation to the function defined at discrete, equidistant points 
over a finite interval. The function approximation is of the form 

F(x) = 0^ + i fon Cos(nK) + b,, Sln(nx)]. 

In addition to providing a model of performances, the function's 
coefficients (a^. and b^.) could provide useful measures. For instance, 
in order for all a^. coefficients to be zero, two characteristics must be 
present in the data: (1) perfect symmetry and (2) zero pitch at 0 and 
90° turn points. The farther from zero the a. are, the farther the 
data are from having the above two characteristics. 
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A program was written to accept as inputs the numl. f perfo .ncc 
to be harmonically analyzed, the number of harmonics to be used in the 
model, and the recorded data. It then printed out the f<«5rived Fourier 
coefficients and the data generated by stepping the model . 0 to IbO 
turn by increments of 5°. Results indicate that this is an extremely 
promising approach to modeling the data, resulting in much ir^re 
realistic and useful standards than can be represented by the mea'i. 

4. DEBRIEFING PLOTS ANALYSIS 

A respectable amount of time was devoted to conceptual analysis of 
the debriefing plots. After becoming familiar with the plots and 
learning to read them, * forty of the plots were shuffled and attempt-, 
were then made by the authors to judge from the plots alone whether tacn 
performance was E, G, F, or U. Out of 40 performances, only 8 v">re 
classified incorrectly. This was an insignificant test, done as much 
out of idle curiosity as for any other reason, and not exactly 
uncontaminated in design. However, it convinces the authors that a 
properly indoctrinated instructor could evaluate performances using 
debriefing plots alone and do the job at least as well and much more 
diagnostically than he can on-site (in-flight). 

Further experimentation was done in this area by devising plastic 
overlays for the plots on which were sketched standard profiles +l<r. 
This is helpful in interpreting the performances and diagnosing errors. 
The approach of using overlays instead of plotting the performances 
against standards would be useful in analyzing the data and debriefing 
the student based on his deviation from norms as well as his deviation 
from standard criteria. 

5. MEASUREMENT APPROACH 

In this effort, the approach to the development of performance 
measures was "analytic" in that it involved and required considerable 
desk-analysis of both the criteria (ATC) and the recorded data. 
Maneuver analyses were performed, measures were postulated, results 
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were examined, a new set of measures was postulated based on the Initial 
results, and finally, these measures were applied to a broad spectrum 
of student and instructor performances^ Analysis of the final results 
included investigating correlations between the measures and subjective 
ratings and then, to a more limited extent, examining the trends of 
measures across individual student performance^ 

The result of this effort was that a good set of prototype measures 
for the lazy 8 was developed, and a similar set for the barrel roll. 
Unfortunately, the measures for the barrel role were less defensible 
'than were those for the lazy 8, because of insufficient data^ The 
validation of these measures was somewhat hampered by such factors as 
lack of IP performance standardization, questionable "text book" 
criteria for the two maneuvers, lack of IP rating standardization, and 
the necessity of using within-subject sampling as a basis for both the 
development and validation of measures^ 

The approach Itself v/as time-consuming to apply due to the need for 
continual interaction with large quantities of data^ It is a workable 
approach given proper manpower support and it enjoys an affinity with 
logical human performance aspects of the maneuvers that is perhaps lacking 
in other more highly automated approaches. It lacks the desirable 
characteristics of requiring less effort to pursue the second time than 
the first, because for each maneuver examined, new and different 
problems arise and each must be treated Individually. 

It is appropriate at this point, to remark that throughout the 
duration of this program, another entirely different approach to 
developing measurement methods was pursued using some of the same data. 
The alternate approach lies at the opposite end of the spectrum from 
this analytic approach with respect to automation and global applicability. 
To pursue the alternate approach, certain functions of the data had to 
be determined and computed. Identification of these functions was 
enhanced through results, as they unfolded, from the analytic approach. 
Thus the two approaches were largely conducted in a complementary 
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fwhion, even though the results from each are reported independently. 
References 3 and 5 dcciiment the alternate approach. 

After having applied this "analytic" approach and, concur? ently, 
a more automated approach (which is based on adaptive modeling), the 
concensus is that neither suffices independently - at least now. The 
analytic approach, although workable, ' is simply too time-consuming to 
be effective in, say, developing measures for an entire training 
curriculum. Also, it suffers from a standardization standpoint in that 
one is never really sure he is finished when using it. This is in turn 
due to a fundamental weakness of the approach in that the types of 
measures it addresses represent only a subset of all possible measures. 
(Conversely, the alternate approach. References 3 and 5, addresses an 
extremely broad spectrum of me^*:«ires.) 

The analytic approach has several noteworthy merits, the main one 
of which is the in-depth understanding one must obtain of the maneuver 
and related performance techniques, and subsequently the application of 
logic and judgment to the problem that would be possible only through 
the utmost in programming sophistication on an automated basis. 

The point to be made is that the analytic approach is too "manual" 
to be efficient on a large scale application and does not address all 
types of measures. More automated approaches take the labor out of the 
job, are widely applicable, and address a broad spectrum of measures, 
but the . 'quire an element of human judgment to be practical. A blend 
of the two types of approaches appears ideal. 

6. MEASUREMENT RESULTS 

For the lazy 8, measurement can* be accomplished using roll, pitch, 
and airspeed. This was demonstrated in this study through the develop- 
ment of a simple error measure, with criteria consisting of values for 
the variables computed from skilled pllot^s data. An improvement on 
this error measure Is believed possible through application of continuous 
rather than discrete error computations as discussed in Section VII. 
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The time and scope of this effort did not permit further pursuit of this 
idea, however. 

The above statements are made without the essential justification that 
good validation, beyond the content validity that existed, would provide. 
When accomplished, validation should include the previously discussed tests 
based on within-subject sampling. Concurrent validation using instructor 
ratings, if conducted, should be pursued as a necessary (not sufficient) 
test, and then only with the cautions previously identified. 

The barrel roll measures could not be developed to the extent they 
were for the lazy 8 due to lacR of sufficient data. From the 
information examined, however, it appears that roll . pitch, normal 
acceleration, and roll-rate will provide the necessary data base Roll 
and pitch are not relevant as single-variable measures; rather, it is 
their relationship that forms the essential measure. The nature of a 
criterion relationship could not be well defined; according to published 
criteria, it appears to be circular, but the actual data of skilled 
pilots does not support the validity or realism of this criterion To 
a greater extent than in the lazy 8. standards must be determined for 
this maneuver. Roll rate measures should reflect the constancy of this 
value after the maneuver is underway. Measures on g's should reflect 
maximum excursions, but here again criteria are lacking, and little 
standardization among IPs was found. 

From a diagnostic standpoint, the debriefing charts would form an 
appropriate media for conveying both measures and diagnostic comments to 
the instructor or student. This would provide the necessary information 
on not just how well the student performed, but why and where he 
performed poorly. 

' It is compelling to bring out one final idea relating to measurement. 
This Idea IS not original with the authors, and it was not pursued in 
this study, but it was so obvious in this study end is so central to any 
final measurement design that this discussion would be incomplete without 
mentioning it. The idea is that measurement of individual performances 
of a maneuver cannot effectively be considered independent^, even if 



ERIC 



242 



AFHRL-TR-72-6 



one is only concerned with one performance at the time. Rather, the 
distribution of measures on successive trials, and if one desires, the 
subsequent probability of successful performance based on that distribution 
is the important consideration. Therefore, measures themselves should 
ultimately be/elcpr&s^'Sed'Tn terms of the resulting distribution. This 
automatically takes into account both the measure(s) achieved and inter- 
performance variance, both of which are considered relevant to pilot 
evaluation. 
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APPENDIX I 

CALIBRATION DATA AND 
CALIBRATION BLOCK DIAGRAMS FOR 
RECORDED FLIGHT DATA 
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Parameter: Heading 



Units: Degrees 



Parameter 
Input 


Transducer 
Output 




Parameter 
Input 


Transducer 
Output 


360 


0 




170 


2.730 


350 


.0 .128 




160 


2.879 


340 


0 .281 




150 


3.017 


330 


0 .404 




140 


3.155 


320 


0 .563 




130 • 


3.324 


310 


0 .701 




120 


3.468 


300 


0 .840 




110 


3.616 


290 


0 .988 




100 


3.744 


280 


1.137 




90 


3.913 


270 


1.280 




80 


4.001 


260 


1.424 




70 


4.170 


250 


1.567 




60 


4.246 


240 


1.711 




50 


4.282 


230 


1.864^ 




40 


4.308 


220 


2.003 




30 


4.334 


210 


2.151 




20 


4.359 


200 


2.305 






190 


2.448 








180 


2.581 









SOURCE 
J-4 Compass 
System 



Collbrotlon Biocfc Dlqqrom 



TRANSDUCER 
^ Synchro 
Fol 1 ower 



EXCITATION 
+5 VDC 



CONDITIONING 



INSTRUMENT 
System Read-Out 
Light Panel 
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Parameter: Altitude Units: Feet (XI 000) 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


n QQ 


f\ loo 








1 • u 


n 1 CO 
U. 1 bo 








1 • D 










9 n 
^ • u 










2.5 ■ 


,0.379 








3.0 


0.450 








4.0 


0.647 








6.0 


0.896 








8.0 


1.206 








10.0 


1.480 








12.0 


1.787 








14.0 


2.100 








16.0 


2.397 








18.0 


2.689 








20.0 


3.002 








22.0 


3.309 








24.0 


3.596 








26.0 


3.908 









Colibrotton Blocit DIogrom 



SOURCE 
Altitude 
Test Set 



EXCITATION 
+5 VDC 



TRANSDUCER 
Altitude 
Model 7000 



^CONDITIONING 



INSTRUMENT 
System Read-Out 
Light Panel 
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Parameter: Airspeed 



Units: Knots 



Parameter 


Transducer 




Parameter 


• Transducer 


Input 


Output 




Input 


Output 


0 


0.491 








60 


0.7836 








70 


• 0.9065 








80 


1 .091 








90 


1.152 








100 


1 .310 








120 


1.585 








140 


1.864 








160 


2.165 








180 


2.438 








200 


2.723 








220 


3.006 








240 


3.267 








260 


3.529 








280 


3.790 








300 


4.025 









CalibrotiOfi Block Dlogrom 



SOURCE 
Airspeed 
Test Set 






TRANSDUCER 
Airspeed 
Model 7100 







EXCITATION 
+5 VDC 



CONDITIONING 



INSTRUMENT 
System Read-Out 
. Light Panel 
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Parameter: Roll Angle Units: Degrees 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


180 . 


5.00 


■ 


- 10 


2.36 


120 


4.27 




- 20 


2.21 


no 


4.12 




- 30 


2.07 


100 


3.98 




- 40 


1.93 


90 


3.83- 




- 50 


1.77 


80 


3.68 




- 60 


1.63 


70 


3.53 




- 70 


1.48 


60 


3.39 




- 80 


1.34 


50 


3.25 




- 90 


1.19 


40 


3.10 




-100 


1.05 


30 


2.95 




-no 


0.91 


20 


2.79 




-120 


0.84 


10 


2.65 




-180 


0 


0 


2.50 






J 



CoHbroHon Block Oloflrom 



SOURCE 




TRANSDUCER 




Tilt 




Gyro 




> 




Table 




MD-1 





Synchro 
Follower 
Pot 











EXCITATION 
+5 VDC 




INSTRUMENT 
Digital 
Voltmeter 
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Parameter: Accel erati on 



Units: g's 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


-7 


-4.9 








+7 • 


+4.9 



















CoUbfqtlon Btocit Diogrom 



SOURCE 


5 


TRANSDUCER 





CONDITIONING 



EXCITATION 



INSTRUMENT 



253 



AFHRL-TR-72-6 



Parameter: Pitch Rate 



Units: Degrees/Second 



Parameter 


Transducer 




Parameter 


Transdii'"er 


Input 


Output 




Input 


Output 


90 


4.98 




-10 


-0.53 


80 


4.47 




-20 


-1.08 


70 


3.92 




-30 


-1.635 


60 


3.36 




-40 


-2.21 


50 


2.79 




-50 


-2.77 


40 


2.23 




-60 


-3.34 


30 


1.66 




-70 


-3.90 


20 


1.095 




-80 


-4.45 


10 


0.545 




-90 


-4.99 


0 


0 









Inland 
Rate Table 
No. 722 



Collbroflon Blocfc Ologrom 



EXCITATION 
115V 400~ 



TRANSDUCER 
Rate 
Gyro 




CONDITIONING 

5I0K , 

C 1 r — WV— C ' 

47K 



33 



0.2mfd 



INSTRUMENT 
Honeywell 333 
Voltmeter 
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Parameter: Roll Rate "Jfi.ts: Oegrees/Se --'nd 



Parameter 


Transducer 




Parameter 


■ Transducer 


Input 


Output 




Input 


1 ■'•itput 


180 


4.6b 




- 20 


'>.495 1 


• 160 


4.13 




- 40 


-i.c ■ 


140 


3.595 




- 60 


-l.F* 


120 


3.07 




- 80 


-2.03 


100 


2.545 




-100 


-2.545 


80 


2.03 




-120 


-3.03 


60 


1..51 




-140 


-3.60 


40 


1.0 




-160 


-4.'!?5 


20 


0.49 




-180 


-4.65 


0 


0 






1 

! 



CoHbfoHon Block Olo^rom 



5MCe 

Inland 
Rate Table 
No. 722 



EXCITATION 
115V 400~ 



TRANSDUCER 
Rate 
Gyro 




ONDITIONINC 

47 K 



0.2 mfd 



390K 



^UMENT 
Honeywell 333 
Voltmeter 
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Parameter: Yaw Rate 



Uni ts : Degrees/Second 









Paramptpr 


Transducer 




Outnut 




Input 


OutDUt 


70 


4 75 








60 


4.135 








50 


3.501 








40 


2.84 








-1 30 


2.14 








20 


1.425 








10 


.705, 








0 


0 








-10 


-0.73 








-20 


-1.45 








-30 


-2.165 








-40 


-2.87 








-50. 


-3.54 








-60 


-4.17 








-70 


-4.78 









SOURCE 

inland 
Rate Table 
No. 722 



CoHbrotlon Blocti DIogrow 



TRANSDUCER 
Rate 
Gyro 



EXCITATION 
115V 400~ 




ONDITIONING 

47 K 



II 



0.2mf4 



-^AAr-B> 



INSTRUMENT 
Honeywell 333 
Voltmeter 
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Parameter: Longitudinal Stick Position Units: Degrees 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


-14.9 


0.16 








-10. 


0.60 








- 8. 


0.78 








- 6. 


1 .00 


■ 






- 4. 


1 .24 








- 2. 


1.45 








0 


1.66 








2. 


1.88 








4. 


2.14 








6. 


2.36 








8. 


2.59 








10. 


2.84 








12. 


3.09 








14. 


3.32 








16. 


3.57 








18. 


3.83 








20. 


4.10 








22. 


4.34 








24.9 


4.74 






1 



CoHbroHon Blocit Otogrom 



SOURCE 
Prop. 
Protractor 



, ^ 

EXCITATION 
+5 VDC 



TRANSDUCER 
Pot 



If' 



CONPTTIONING 



INSTRUMENT 
Digital 
Voltmeter 
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•Parameter: Lateral Stick Position 



Units: Degrees 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


1 D 


\J.CI 








m 










XL 


U * O 1 








in 


in 








8 


1.43 






- 


Q 


1 fiQ 








4 


1.94 








2 


2.24 








0 


2.48 








- 2 


2.75 








- 4 


3.00 








- 6 


3.28 








- 8 


3.61 








-10 


3.89 








-12 


4.23 








-14 


4.59 








-16 


5.00 



















SOUKCE 
Prop. 
Protractor 



Collbrotlon Blocfc DIogrow 



TRANSDUCER 
Pot 



V CONDITIONING 



EXCITATION 
+5 VDC 



INSTRUMENT 
Digital 
Voltmeter 
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Parameter: Rudder Position 



Units: Degrees 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


24 


0.07 




- 2 


2.80 


22 


0.4 




- 4 


3.00 


18 


0.8 




- 6 


3.20 


14 


1.18 




- 8 


3.40 


10 


1.57 




-10 


3.60 


8 


1.78 




-14 


4.00 


6 


2.00 




-18 " 


4.40 


4 


2.17 




-22 


4.80 


2 


2.40 




-24 


5.00 


0 


2.54 









SOURCE 
Rudder 
Protractor 



Cflllbrotiow Blocfc Dtatraiii 



TRANSDUCER 
Pot 



EXCITATION 
+5 VOC 



CONDITIONING 



INSTRUMENT 
Digital 
Vol tmeter 
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Parameter: Throttle Position Units: Degrees 



Parameter 


Transducer 




Parameter 


Transducer 


Input 


Output 




Input 


Output 


0 


0.23 








16 


1.72 


L 






32 


2.76 


E 






48 


3.72 


F 






64 


4.G4 


T 






0 


0.39 


R 






16 


1.82 


I 






32 


2.87 


G 






48 


3.85 


H 






64 


4.61 


T 







Calibrotiow Blocli Ditiram 



SOURCE 
Throttle 



TRANSDUCER 
Pot 
{2K) 



EXCITATION 
+5 VDC 



/coiS 



CONDITIONING^ 



INSTRUMENT 
Digital 
Voltmeter 
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APPENDIX II 
ILLUSTRATION OF INITIAL PRINT-OUT FORMAT 



Note: Three pages of computer print out 

were required to represent approximately 
50 seconds of data. 
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APPENDIX III 



SOFTWARE FOR DATA CALIBRATION 
AND 

INITIAL PRINT-OUT 



ERJC 
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$JOB 

SSFTUP A( 1) 
SipJOR RUTHRF 
SIrFTC T37DAT 



0»5 »5000 
Xl895»Xl856-,-9 

MAP 

M9A»XR7,N0DECK 



69-026»GUTHRIE» ROOM 
UNIT lA 22 OCT 70 



209 BLOCK 
FLIGHT 2-8 



C SSFTUP A(l) RFAf) THF RAW DATA (36 RiT WOROS WRITTFN AT 556 DFNSITY 
r TN NON DCS BLOrKINr.) FROM TAPF >:189'5 AND SKIP AS MANY AS 9 

C REDUNDANT RECORDS. ACCOMPLISH DCS BLOCKING AND wRItE Out THF RAW 

C DATA AT DFNSITY 800 ON TAPF X1856 AND RFWl.ND. 

DIMENSION A(AlO) 
INTEGER RECORD 
C READ AND COUNT THE RECORDS WRITTEN ON TAPE Xl856. 
REC0PO=0 

C THE SYMBOLICS FOR SIO. (CALL READ) AND UNITS ARE IN THE MAIN DECK 

1 CALL READ (1A,A,K»N) 
REC0RD=REC0RD+1 

IF (MOOfRFCORD* 100) •NF.O) GO TO A 
PRINT 5»RF:0RD 
5 FORMAT (8H RFC0RD=»I6) 
4 N=N+1 

GO TO ( 1»2»3) tN 
C CALL FXEM GIvES AN ERROR 
C SYMBOLICS NOT INCLUDED 

3 CALL FXFM 

2 REC0RD=RFC0RD-1 
PRINT 5»REC0RD 
STOP 
END 

SIBLDR SIO. 
$TFXT SIO. 

*N • *»*7( *7( *7-0 »75 7a ' ' 5A9 7 
»N97P*»7X$7\/*X-)6 E S76'A 2' $7' , 

A ?' X 6 '69G 

7E(0 G7Z76 5 774 A 
76 G6) 76'A 2' ) • 
75»7»- 0 5 7- 76776 
-6»5 7- 7»++ 5597» 0 
») P 9 8 



TRACE AND RETURNS CONTROL TO THE SYSTEM 



»Nfl( )*''7V<7V*7 
»N96(((X(*X(*7 
»N7ri) (»7(»7X*7 
»N»RX)*7*»7X*7 
^*N«NX(»7(»7(*7 
»T .«*(»77 
SCDICT SIO. 
*N XZ*84 1»*)P8A 
»19Z» ( (#*- ( )G- 
$DKFND SIO. 
SIRLDR UNITS 
SFILE UNITS 
SFILE UNITS 
SFILE UNITS 
$FILF UNITS 
SFILE UNITS 
SFD^CT UI^ITS 
»J (('42'* 



25 SuP 67 



•7A07A87597A956976 *> 976776 AM7'6 7 

5 7« 76776 74(5M»4A7» U5M»76 
OS YS (G7 7S7'69) 0769S Y)7 7S»7»C 
99M»5 7» (4 79M»5 7- 76776 )4M 
••6 '690 05 )G7 757»69) 0) 076^5 Y)7 
76»A 2' »' X7A9AM776 0677577*0 5 
5594A9' X 7A-02X83' 25690 



*)P UMPP S'*(P U'*<^( X«(*)-6 P*)- ()*- i*P- ((*- 



18 SFP 69 
•UNITIA' tA( 1 ) tlNPUT tBINtPLK^AlO 
•UNITIS' »A(2) »INOUT»RiNtPLK=1080 
'UNIT16* »A( 3) tlNOUT fPIN » RLK= 1080 
'UNIT17» »A( A) »OUTPUT»RIN»RLK = 1080 
MJNIT18» »A( 5) »Oi;TPUT »BIN»RLK=1080 

*(7PPPPPP72P *(»PPPPPP72P . »(»PPPPPP72P »(»PPPPPP 



»A9P7P' 2P »(6PPPPPP 



SIO.OOOO 
SlO.OOOl 
•SIO. 000? 
•SIO.OOOO 
SIO.QOOa 
•SIO*0005 
SI0.D006 
SIO. 0007 
SIO. 0008 
SIO. 0009 
SlO.COlO 
SIC.OOll 
SIO. 001? 
SIO. 0013 
UNITSOOO 
UNlTSOOl 
UNITSOO? 
UNITS003 
UN ITSOOA 
UNITS005 
UNITS006 
UNITS007 
UNITS008 



$TFXT UNITS UNITS0^9 

»T =*7»XG I H I G ) UNlTSOlO 

SCnlCT UNITS UNlTSOll 

»V *(5 A 1»*(P A X.» X.' 9X** 8X.' 9X*( 7 uNlTSOl? 

SDKFND UNITS UNITSOI^ 
• END OF FILE CARD 
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GUTh.^le ROOM 
15 OCT 70 



209 r^TART 
FLIGHT 2-5 



^JOR 0»S»50O0 69-026 

S>SnuP A(l) X1856,N0RING UNIT 14 
SSFTUP A(2) X191A UNIT 15 
SSFTUP A(3) TAPE UNIT 16 

ilBFTC T37DAT M9A ♦XR7 tNODECK 

C EACH FOOT OF MAGNETIC TAPE AT 800 DENSITY WILL HOLD 1300 36BIT 

rLOATiNG POINT WORDS INCLUDING DCS BLOCKING. 1700 RECORDS REOUlRF 
1805 FEET OF TAPE* 1 700* (( 1 2*?5 )+( 1 20*9 ))/ 1 300 

THE WORD RECORD WHEN USED IN RfFERENCF TO UNITS 15 AND 16 VPANS 

iecV'^S^I*;''*^"^*^^^'*^"^*^' ^^"^ nA2A(i,j),i = i,i7),j.i,?5)=:n8o wrs 

SSFTUP Ad) X1856 DCS RLOCKFn RAw DATA 

TAPE TO CONTAIN THE FIRST 1700 RECORDS OF 



C 
C 
C 
C 
C 
C 
C 
C 



$SETUP A(^) X19U 

CALIRRATPD DATA 
iSETUP A(3) TAPE 
TAPE IS RFOUIREO 



MORF THAN 1700 RECORDS AN ADDITIONAL 



C 

c 
c 



c 
c 

c 
c 



97 



9R 



99 



IF THERE ARE 

ON UNIT 16 

DIMENSION A(A10)»M(1C0),W0RDS( 100) »TAPFS(2) 

COMMON /Al/ N12,N120,RECORD»IUNIT»N,TAPE»INP(100).JCOL(100). 
3XARRAY(51,18),YARRAY(5U18),JCAL(100),I?A»I2A0 
COMMON /A2/ J1»A24(2A,25),A2AO(240,9),CYCLE,S^T. 
INTEGER RECORDfSET 
NAMFLIST /NAMl/ ITAPE»IP«IPD 
READ (S»l ) TAPE 
TAPE THE RFEL NljMRPR TO RF MOuNTFD ON A(l) mNIt U 
FORMAT (A6) 
PPAH (S»NAM1) 
J1516=15 
SFT = 0 
CYCLE=0.0 
RECORD=0 
J1=0 
IUNIT=14 

READ AND WRITE INTEGER CONTROL VECTORS 
JCOL(IOO) CONTAINS THE COLUMN NUMBER (J) OF XARRAY(NP,J) 
(MP » J ) 

RF^AD (S»?) (JrOL( I ) »I = 1»100) 
FORMAT (2014) 

INP(IOO) CONTAINS THE NUMBER OF POINTS (NP) OF XARRAY(NP»J) AND 
YARRA Y ( NP » J ) 

RFAf) ( 5»2) ( INP( I ) » ItI »100) 
JCAL(IOO) CONTAINS THE COLUMN NUMBER OF THE CALIBRATED DATA TO BE 
STORED IN A240(I»J) AND A24(NJ-6) 
READ (S,2) (JCAL( I ) »I=1»100) 
WRITE (6»97) (JCOL( I) » 1=] »100) 
FORMAT (12H0JCOL VFCT0R/1X/(1X»20I6) ) 
WRTTF (6,98) ( INP( I)»I=1»100) 
FORMAT (IIHOINP VECTOR/ 1 X / ( 1 X » ?C 1 6 ) ) 
WRITE (6»99) (JCALC I)»I = 1,100) 
PORMAT (12H0JCAL VECTOR/ 1 x/ ( Ix » 20 16 ) ) 
PEAD AND WRITE THE CALIBRATION DATA 
DO 3 J=l* 18 



MAINOO 
MAINOI 
MA1N07 

MAIN04 
MAIN05 
MAIM06 

MAIN07 
MAIM08 
MAIN09 
MAINIO 
MAINII 
MAIN12 
MAIN13 
MAINIA 

YARRAYMAIN15 
MAIN16 
MAIN17 
MAIN18 
MAIN19 
MAIN20 
MAIN21 
MAIN22 
MAIN23 
MAIN24 
MAIN25 
MAIN26 
MAIN27 
MAIM28 
MAIN29 
MAIN30 

MAIN31 
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49 



3 

13 



READ LABFLX»LABELY»NP 


MAIN32 


FORMAT (A6»5X»A&»5X»I2) 


MAIN33 


RFAD tXARRAYM »J) » I=1»NP) 


MAIN3A 


RFAn (5»5) (YARRAYf I f J) » I=1»NP) 


MAIN3«> 


FORMAT ( 10F8.3) 


MAIN36 


WRITF {f>9U9) LABFLXtl APFLYtNP 


MAIN37 


FORMAT ( lH0,A6»5X»A6f *)Xt 12) 


MAIN3B 


WRTTF (6,50) (XARRAY( I ,J) ,1 = 1 ,NP) 


MAIN39 


WRITE (6»50) ( YARRAY( I ,J) ,1 = 1 ,NP) 


MAINAO 


FORMAT ( lHO»10Fl2*3/(lXf 10F17.3) ) 


MAINAI 


rONTlNlIF 


MAIN42 


PRINT 13tJl5l6 


MAIN43 


FORMAT (6H UNlT=»U) 


MAIN44 


N12 = 0 


MAINA6 


N120=0 


MAINA6 


CALL CYCLFS (A, M, WORDS) 


MAINA7 


Nl?- J2 


MAINA8 


N12n=l?0 


MAIN49 


CALL- CYCLFS (AtM^wORDS) 


MATN50 



( A24f?'«,25f !t6f0,l ) 
( A24,2/»,25,! ,7f0.1 ) 



( A240,240»9,I 
( A?/*0,2/»0»9,T 
( A240,2A0»9,T 



*3fO< 



01) 
01) 
01) 



C DIFFERFNTIATF VERTICAL VFLOC ITY = A;?4 ( I ,2 1 ) ,TuRN RATF=A2A( I , 22 ) » STICK 
C RATE L0NG1TUDINAI. = A240( ! ,7) ,.ST1CK RATF L ATERAL = A2A0 ( I , 8 ) t RUDDER RATF 
C =A24()( 1,9) 

DO 6 1 = 1 •12 
A24( I,?1;=DIFF 

6 A24( I ,22)=DIFF 
DO 7 1=1,120 
A240(I,7)=DIFF 
AH^Od ,8)=DIFF 

7 A240( I,9)=DIFF 
If (RFCORD.OT.? ) GO TO 48 
A?^4(1,20)=A240( 1 ,?)^ 
A?4(l,?3>=0,0 
A2^ (1 ,24) =A240( 1 tl ) 

C INTFGRATF R0LL=A24( ! * 20 ) , YAv-*=A24 ( 1,23) ,PlTCH=/i24( I ,24) 
48 DO 8 I =2, 13 

A. ' T,'>0)=A24( I-l,20)+0,05*( A24( I ,?)+A74( !-!,?)) 
A 24 I • ,23) =A24( 1-1,23 )+0. 05* (A24( I ♦8)+A24( 1-1,8) ) 
A24( I »24J =A24( ! - 1 , 24 ) +0 • 05* ( A24 { I , 3 7)+A24( I-l , 17i ) 

8 CON^ !Nnr 

C WHKN I ^PF,^4F,0 WP!"F OUT CALIBRATFH DATA ON UNIT 1*^ (J1516 = 15) OR ON 
C UNIT 1<« (Jl'i16=H)) 

IF .APl.FO.O) GO TO 10 

WRITE (Jl*^16) ( ( A?40( I , J ) ,1 = 1 ,170) , J=l ,9) 
WRITE (Jl^SU) ( (A?4( I,J) ,1 = 1 ,1?) ,J=1 ,2*^) 
10 CALL SELECT ( IP.IPD) 
C SUBROUTINE SELECT SETS N = 2 U'HEN AN END OF FRF IS ENCOuNTERFn 
00 TO (21 22) tN 



MAINSI 
MAIN52 
MAIN53 
MAIN54 
MAIN55 
MAIN56 
MAIN57 
MAINSR 
MAIN59 
MAIN60 
MAIN61 

MAIN67 
MAIN63 
MAIN64 
MAIN65 
MAIN66 



MAIN67 
MATNoS 
MAIN69 
M,AIN70 



SHIFT THE Current cycle of calibrated data to the previous cycle 



M'AIN71 



C STORAGE AREA SO AS TO ALLOW THE DIFFERENTION AND INTEGRATION 

C TO BE CONTINUOUS 

DO 15 !M3»24 
00 15 J=l,?5 
A?4( I-1?»J) = A?4( I, J) 
DO 16 1=121 ,240 
no 16 J=l ,9 

A?40(I-1?0,J)=A240( I ,J) 
!F (RECORD-1701 ) 9tll,12 
J1516=16 
PRINT 13,J1516 
GO TO 9 

J. (RECORD-3401) 9,22»?2 
CALL PRINT 
STOP 
END 



21 
1*^ 



16 



11 



12 
2? 



•MAIN72 
MAIN7^ 
MAIN74 
MAIN75 
MAIN76 
MAIN77 
MAIN78 
MAiN79 
MAIN80 
MAIN81 
MAIN82 
MAIN83 
MAIN84 
MAIN85 



270 



AFHRL-TR.72-6 



StIPROUTINP rvr^pc^ (At'SWORHf. 
C SUBROUTINE CYCLFS E XTRAC TS »r AL I R^ ^: ^ AND STORES F0« ' l.AJQR , f 
C OF 100 WORDS 

OrMENSlON At4lO) fMt 100) ♦WORDS( 100) 

COMMON /Al/ N1?,N1?0»RFCORO, lUNlTWi, ''F^InPm^OO^ -i ^ , 
1XARRAY( 51 f\H) ,YARKAY(*)' , 18) , jrAL ( in: ■ , J?/,, i \ 
v^OMMON /A?/ Jl ♦A?4(2/«»;>'^) ♦A?<i0(,'>40, / .ryjUFf T 
r.nFGFR RFrORHtSFT 

RFCORn=REroRn+i 

C CALL READ ( I UN 1 T » A ♦ K»N ) THIS SUf^lROUTINP PrRMlT<; r^.^t ■ ( t\ F«^OM 

C FORTRAN Iv TO tOCS AND ALLOWS THE CALLING PROGRAM ? ' 

C CONTROL IF AN END OE FILE OR P^'PVANrr^r RP" •IM'^ ft^♦C Y I^ \ ^rOM,,.-p ^ 

CALL READ ( HJNI ^ »A»K»N) 
C WRITF OUT THE FIRST TOUR RAW DATA RlNARv RFCOROS. 
' IF (RFCORn.LT.S) WRITf {6»1'*>) ( A ( 1) ♦ ^ = 1 1 0 ) 
10 FORMAT (9H1A MATRlX/lX/( 1Xf8ni6) ) 
N = N+l 

C K=NO, WORDS IN RECORD A» GOOD RrADMN=l)» END C/- FILE (N = 2Jf 

C PERMANENT REDUNDANCY (N=3) 

GO TO ( 1 t?*^) fN 
1 IE (K,F0,610) GO TO 

WRITF (6*4) KtRFrORn«TAPr,f! 
A FORMAT (12M0THFRF ARF t 1 5, • 1 7nvORO<- IN R^-TOPO .rMlX-fSHf VAPr 
1 ♦A6»'^X»?HN=,IS) 
CALL FXFM 
y WRITE (6»5) TAPE •RF^ORf^,N 

5 FORMAT (S-^HOEND OF FILE ENCOuNTERfD ON TAPi; ,A6»nH IN RECORD, l6. 
nx»2HN=» K ' 
DO 17 I=13»24 

no 17 j = i,;?5 

17 A?4(UJ)=0,0 

DO 18 I=l?l,?40 \ 

DO 18 J=l ,9 
1« A;>40( I ♦ J)=0,0 

RFTtiRN 

WRITE (6»6) TAPF •RFCORDtN 
o FORMAT (4?H0PERMANrNT REDUNDANCY ENCOUNTERED ON TAPE ^Aet 
mn IN RECORD •I6»3X»?HN=» 15) 
CALL PRINT 
CAL*. EXEM 



7 124=N1? 

I240=N120 




DO 9 I^Pt-^T^f^A 
CYCLF=CYCLE+1.0 
I?4::I24+1 



DO 8 J=l»100 

8 M(J)=0 

C CALL A MAP CODED SUBROUTINE TO EXTRACT THE NECESSARY 12 BIT DATA 
C WORDS AND C i^vERT THE flMF WORDS TO SECONDS 

CALL XTRACT ( Ad ) •M(2) ) 
C CONVERT THE 1? BIT INTEGER WORDS (STORED ONE PER 36 BIT WORD) TO REAL 
C FLOATING POINT WORDS AND PERFORM THE NECESSARY CALIBRATION 

CALL CALBRT (M»WORDS) 

CALL STORE (WORDS) 

9 CONTINUE 
RFTiiRN 
c-ND 
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SIRFTC STORES M94»XR7»0ECK 

SUBROUTINF STORE (WORDS) 

COMMON /Al/ N12»N12C»REC0RD»IuNlT»NtTAPE»INP(100)»JC0L(100) » 
'lXARRAY(51»18) »YARRAY(51»18UJCAL(100) ,r24tr2/if> 
COMMON /A2/ Jl»A2A(2^»25)»A2/40(2AO»9)»rYCLE»!^FT 
INTEGER SET 
DIMFNsrOfI wOROSClOO) 
DO I U=l»100 
J=jrAL(L) 

If iJ.fQ.Oi GO TO 1 

IF tJ«GT«6) GO TO 2 

IF (J.EO.l) 1240=1240+1 

A240 ( 1 2 40 » J ) =W0R05; ( L ) 

GO TO 1 
2 A24C I2^»J-6)=W0R0S(Lh 
1 CONTINUE 

A24C I24»25}=CYCLE/10«0 

RETURN 

END 
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SlR.-rr SFLFCX 0FCKfM9i^,XR7 

SU'^ROIITINF 5ELFCT (It ID) 
C FROM THF CALIBRATED DATA STORED IN A2^ AND A2^0 SELECT THE SERIES 
C IP+IPDfIP+2IPD+«««T0 BE PRINTED 

COMMON /Al/ Nl2»Nl?0fREC0RD,IuNlTfN,TAPEf INP{100)f JCOL(ICO) • 
1XARRAY(51,18) » YARRAY ( 51 • 18) • JCAL( IOC ) 1 1 24, I 2A0 

COMMON /A2/ J!.A24{2A,25) fA240(240.9),CYCLF,SFT 

COMMON /A3/ PAGEKSOf 12) fPAGF2(50tl3) •PAGF^C'jOf 12) 

INTEGER RFCORDfSET 



f p f f IP 
1 r t 1 • L r 


• 1/1 


iiU I U ^ 


I - I— IZ 






RFTuRN 






J=l 0* 1—9 






Jl= Jl+l 






H Afir 1 1 J 1 


• J ) 


-A?«» t 1 • 1 ) 




• /) 


- A/JH*' t J 90 ) 


P hfid t 11 




— A 0/."f f ^ »' 


P A/Tpl / 11 


. iM.\ 


— AcH 1 1 • £ 1 1 










. At 
9 0) 




DA/*f1/ ll 


• » 1 


— HOA/'f IT* 


D Af^P If 11 


ft t 


— A i?«*W 1 J • 3 ) 


PAGEK Jl 


. 9) 


=A240( J»7) 


PAGFK Jl 


• 10) 


= A24{ I,4)- 


PAGFK Jl 


»11) 


=A24(T,5) 


PAGFlt Jl 


• 1?) 


=A24(If9) 


PA6E2( Jl 


9 1) 


=A24( 1,19) 


PAGE2( Jl 


9 2) 


=A24( I 97) 


PAGE2( Jl 


9 3) 


=A^4( If22) 


PAGE2t Jl 


9 4) 


=A240{J,2) 


PAGF2( Jl 


► 5) 


=A24{ U20) 


PAGF2( Jl 


> 6) 


=A24( I,2) 


PAGF?( Jl 


► 7) 


=A?.40( Jf4) 


PAGF?( Jl 


» 8) 


=A?40( Jffl) 


PAGF2( Jli 


> 9) 


=A24{ N3) 


PAGF2(-J1 1 


>10) 


=A?4( If?^) 


PAGr2( Jli 


»11) 


=A?4{ 1,8) 


PAGF?( Jli 


► 1?) 


=A240{ Jf«i) 


PAGF2( Jli 


^3) 


=A240{ J,9) 


PAGE3( Jli 


> 1) 


=A24< N19) 


PAGE3( Jli 


► 2) 


=A24{ I»13} 


PAGF3( Jl, 


> 3) 


=A24( N15) 


PAGF3{ Jli 


^ 4) 


=A24{ T»14) 


PAGF3{ Jli 


> 5) 


=A?4{ N16) 


PAGF3{ Jli 


6) 


=A?4% Nil) 


PAGF3{ Jli 


7) 


=A24( 1,10) 


PAGF3{ Jli 


8) 


=A24( U12) 


PAGF3{ Jl 1 


O) 


=A?4( I •! ) 


PAGF3{ Jli 


10) 


=A24( 1,18 J 


PAGF3{ Jli 


11) 


=A?4( N25) 



PAGE3{ J1»12)=REC0RD-1 
IF {J1«LT«50) GO TO 33 
CALL PRINT 

3S i = i-nn 

GO TO 1 
END 
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SIRFTC PRINTS nFnC»M9/i»XR7 
SUBROUTINE PRINT 

COMMON /A2/ J1»A24(Z4,2&) »A240(240»9) ,CYCLE»SET 
COMMON /A3/ PAGE1(50»12) »PAGE2(50»13) »PAGE3(50»12) 
INTEGER SET 
IF (Jl.EO.O) RETURN 
SET=SET+1 
14 WRITE t6»31) SET 

31 FORMAT (13H1PAGE 1 SFT»I5/ 

C 5X»4HTIME»I0H A IRSPEED»llH ALTITUDE »10H VFRT 

1ICAL»5x»5HPItCH,7x»5HPItCH,4x»5HPITCH,12H STICK P0s.»13H STlCK 
?RATE-»11H ELEVATOR »11H ELEVATOR »8x»6HMORMAL/32X »8HvEL0ClTY»l0H 
> (ACTUAL) ,12H (COMPUTFO) »5x »4HRAtF ,5x ,7h( LONG. ) ,6X » 7M( LONG. ) ,5x»6 
4HTAB UPfllH TAB n0wN»l4H AffFL^RAT ION/ 1 X ) 
WRITE (6,41) ((PAGEK IR»IC)»FLAG1 ( IR » I C ) » IC=1 • 12 ) » I R=l » Jl) 
41 FORMAT ( lX»F7.2,Al,F9.2,Al,Fl0.2,Al,F9.2,Al ,F9.2,Al ,Fl U2 ,Al ♦FS.^, 
1A1,F11.2«AUF12«2«A1 ,F10*0,A1 «FlO.O « Al ,F1 3.2, A 1 ) 
WRITE (6»32) SET 

32 FORMAT ( 13H1PAGE 2 SET » 15/ 

C 4x»4HtlMEt9H HEAD ING »4X »4HtuRN » 6X »4hR0LL » 8X »4hR 

10LL,5x»4HROLL»12H STICK P0S.,12H STICK RATE* 7x »7HLATERAL»9x •3HYA 
2W»6X»3HYAW»8H RuOnER»9H R(JDDER/21X»4HRATF^»10H ( ACTOAL) »12H (T 
30MPUTED)»5X»4HRATE»12H ( LATERAL )» 12H (LATFRaL) tl^H AfCFLFRATl 
40N»12H (COf^PuTED) »5X •4HRATE* 13X »4HRATF/1 X ) 
WRITE* t 6»42) (.(PAGF2( IR» IC) »FLAG2 t IR» IC) » I C = l » 13 ) » IR=1»J1 ) 
4? FORMAT ( 1X.F7.2»A1»F7.2»A1»F7.2»A1 »F9. 2 » A 1 »F1 1 •2» A 1 »F8.2 • Al » Fl 1. 2 . 
lAl.Fll.2.Al»F13.2»Al»F11.2»Al,F8.7,Al,F7.2»Al,r8.2»Al) 
WRITE (6»33) SET 

33 FORMAT ( 13H1PAGF 3 SET»I5/ 

C 5X.4HTIME'.11H THROTTLE f^X* 3HRPM, llH THROTTLE 

1»7X.3HRPM,8H SPEEn»5X»5HFLAPS»10H LANDING* 7X .eHTHRUST .9X • 
25HFVENT •9X»4HTIME»7X»6HREC0RD/14X .6 ^( LEFT ) •4X»6H(LrFT) •4X»7h( RIGHT 
3 ) » lOH (RIGHT ) • 8H BRAKE* 1 6X •4HriF AR « 1 3H ATTFNl TATOR •SX •6HMUMRFR 
4»8X»5HCYCLE/1X) 

WRITE (6»43) ( (PAr,F3( IR» IC)»FLAri3( IR . ID • ir=l » 12 ) • IR=1 » Jl ) 
43 FORMAT ( 1X,F7.2 • A 1 •F10.2 • Al fPg. 2 • Al ,K 1 0.2. Al ,F9.7 , Al •F7.0,A1 •F^.?* 
1A1,F9.0.A1 .F12.0»A1 »F13.0 »Al •F12.1 .AUrl2.0,M ) 

J1=0 

RETURN 

END 
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SIftMAP XTRATC DECK 
XTRACT SAVE 





CLA 


3»4 




ST A 


Nl 




ST A 






STA 


N6 




*^TA 


Nin 




CLA 






STA 


M2 




STA 


m 




STA 


N7 




STA 


Nd 




STA 


N12 


Nl 


LOO 


- »# 




ROL 


25 




* PXA 


• 0 




LLS 


10 




CHS 




N? 


STO 


«» 




AXT 


-1»2 




AXT 






LDO 






AXT 


3»4 


N5 


ROL 


1 




PXA 


♦ 0 




LLS 


10 




CHS 






STO 


*»f2 




ROL 


1 - 




TXI 


«+l f 2f-l 




TTX 


N5»4tl 




Txr 






TXH 


N3tl t-32 


N6 


LDO 


»»»1 




ROL 


1 




PXA 


tO 




LLS 


10 




CHS 




N7 


STO 


• ♦♦,2 




ROL 


1 




TXT 


♦+U2»-1 




ROL 


1 




PXA 


»o 




LLS 


10 




CHS 




N8 


STO 


♦»»2 




PXA 


»0 




AXT 


0»4 



ERIC 
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RQL 


1 


RQL 


1 


TOP 


»+2 


ADD 


SEC1.4 


TXI 




TXH 




TXI 




LDO 




AXT 


0*4 


RQL 


1 


RQL 


I 


TQP 


*+2 


ADD 


SEC2»4 


Txr 




TXH 


Nll»4,-10 


TXT 


*+1.2»-l 


STO 


**»2 


RFtURN 


XTRACT 


DFC 


240 


DPC 


72000 


DEC 


36000 


DEC 


28800 


DEC 


14400 


DCC 


7200 


DEC 


3600 


DFC 


2400 


DFC 


1200 


DffC 


600 


DEC 


480 


DFC • 


120 


DEC 


60 


DEC 


40 


DEC 


20 


DEC 


10 


DEC 


8 


DEC 


4 


DFC 


2 


"DEC 


1 


END 
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nowDFLL 



SIPMAP SIO. DECK SEPT 

TTL SIMPLIFIFD IOCS SUBROUTINE 

* SIMPLIFIFD INPUTrOUTPUT CONTROL SYSTEM - 21 SFPTFMRFR 
«• THIS SUBROUTINE PERMITS DIRECT CALL FROM 

* FORTRAN IV TO IOCS ROUT INES( OPEN»READ»WR I TE»CL0SE ) 



THE VARIOUS CALLING SEQUENCES ARE- 
CALL CLOSE(N»M) 

N=LOGICAL TAPE 

M=(0=NO REWIND* NO FOF ON OUTPUT) 
=(l=RFWlNn, WRITE EOF ON OUTPUT) 
=(2=N0 REWIND* WRITE EOF ON OUTPUT) 
=(3=REWIN0» UNLOAD, WRITF EOF ON OUTPUT) 
MODIFIED SIO. TO ?ETURN THE WORD COUNT IN K 
CALL READ(N»A>K,J) 
N=LOGICAL TAPE 

A=LOCATION OF DATA AREA FOR READ 
K=NUMBER OF WORDS TO BE -READ 

J=STATUS SWITCH(0=GdOD READ)»(1=END OF FILE)»(2= 
CALL WRI TE(N,A',K) 
N=L6GICAL fAPE 

A=L0CATI0N OF AREA FOR WRITE 
K=NUMBER OF WORDS TO BE WRITTEN 
CALL BKSFIL(N»M) 
N=LOGICAL TAPE 
M=NO. OF FILES 
2 

READXtREADY 
WRITX»WRITY 
CLOSX»CLOSY 
BKSFX»BKSFY 
2 

SAVE AND EXIT FOR ALL ROUTINES 
(2*4) , I 
LK.DR,4 
1 »1 

SAVE 
2 

CLOSE SUBROUTINE 
EXIT»1 



PERM REDUN) 



READ 
WRITE 
CLOSh' 
BKSFIL 



SAVE 



EXIT 



CLOSX 



SPACE 
CONTRL 
CONTRL 
CONTRL 
CONTRL 
SPACE 
REM 
SAVEN 
SXA 
TRA 
AXT 

RETURN 
SPACE 
REM 
SXA 
TSX 
CLA» 
PAC 
LDO 
ROL 
SLQ 
TSX 



EXIT ROUTINE 



SAVEtl 

4,4 

0,1 

PREFIX 
0,1 

CL05F1+1 
FVI0,1 



SAVE 
SET 



ROUTINE 
REWIND OPl 



ION 



ROTATE PREFIX CONSTANT 
TO FORM DESIRED PREFIX 
PZr,MZE PTW,M0N ' 
FIMD LOC(FCB) 



SIO. 000 

SI0CS002 

SI0CS005 
SIOCS006 
SI0CS007 
SI0CS008 
SI0CS009 
SlOCSOlO 
SIOCSOll 
SI0CS012 
SI0CS013 
SIOCSOU 

SI0CS015 
SIOCSOU 
SI0CS017 
SI0CS018 

siocsoi9 

SI0CS020 
SI0CS021 

sioc:so22 

SI0CS023 
SI0CS024 
SlbcS025 
SI0CS026 
SI0CS027 



SI0CS032 

SI0CS034 . 
SIOCS035 

srocs636 

SIOCS037 
SIOCS038 
SI0CS039 
SI0CS040 

SI0CS042 
SI0CS043 
SI0CS044 
SI0CS045 
SI0CS046 
SI0CS047 
SrOCS04 8 
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CLA 


F. 


STORE LOC(FCB) 


SI0C5049 




STA 


CLOSEl+1 




siorsoso 


CLOSE] 


TSX 


•CLOSE .4 


CALL TO IOCS 


SI0CS051 




PZE 


«* 




SI0CS052 




TRA 


EXIT 


RETURN 


SlOCsb53 


CLOSY 


BSS 


0 








SPACE 


2 




SI0CS054 




REM' 


READ SUBROUTINE 




SI0CS055 


RtADX 


SXA 


FXTT,1 


"> 






TSX 


SAVE.l 


SAVE ROUTINE 


SI0CSO37 




SXA 


RFAD2f A 




SI0CS058 




CLA 


4f 4 


FIND READ ADDRESS 


SIOCS059 




STA' 


READl+3 




ST0CS06*0 




CLA 










STA 


00 








STZ* 


6*4 


ZERO FRROR SWITCH 


SlOCSb64 




TSX 


FVI0»1 


FIND LOC<FCB) 


SI0CS065 




CLA 


E» 




SI0CS066 




STA 


READl+1 




SI0CS067 




STA 


OPN+1 




SI0CS068 




STA 


CLS+1 




SIOCS069 




PAC 


Otl 




SI0CS070 




LDI 


1 »1 


FCB WORD 2 


SI0CS071 




LFT 


003000 


WAS PREVIOUS (I5F INPUT 


SI0CS07? 




TRA 


*+2 


N0» Must reset 


SIOCS073 




TRA 


READ5 


YES» CaO CHECK .OPEN 


^SIOCS074 




LFT 


04 0000 


IS FILE CLOSED 


- SI0CS075 




TSX 


CLS»2 


NOf CLOSE IT 


SI0CS076 




LDI 


1 »1 




SI0CS077 




RIL 


003000 


SET TO INPUT (00) 


SI0CS078 




ST I 


1 •! 




SI0CS079 




TRA 


*+2 




SI0CS080 


READS 


LNT 


04 0000 


IS FILE OPEN 


SI0CS081 




TSX 


0PN.2 




sidcso8^ 


READl 


TSX 


•RFAD»4 


CALL TO IOCS 


SI0CS08'^ 




PZF 


»» 




SIOCS084 




PZE 


REAn2» •RFAD3 


FOFf .REDUN 


^siorso85 




lORT 










LXD 








00 


SXA 


»»f 1 








TRA 


EXIT 




SIOCS087 


READ2 


AXT 


»»,4 


RESTORE IR4 


SI0CS088 




CLA 


= 1 


SET EOF SWITCH 


SI0CS089 




STO» 


6f4 




SI0CS090 




TRA 


EXIT 


RETURN 


SIOCS091 


REAja 


XEC 


REAn2 


RESTORE IR4 


SI0CS092 




CLA 




SFT PERM RFDUN 


SI0CS093 




STO» 


6*4 


SWITCH 


SlOrS094 




TRA 


EXIT 


RETURN 


SI0rS095 




<; 


0 







ERIC 
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SPACE 


2 


• 




RFM " 


WRITE SUBROi'TiN? 




WRITX 


SXA 


rxiTti 






TSX 


5AVE»1 


SAVE ROUTINE 




CLA 


UfU 


FINO'WRITF AnoRRsS 




ST A 


WRlTF.U? 




rLA« 




FIND NO WORlSs 




PAX 


0,1 






sxr 


WRITF1 + ;>»1 , 






TSX 


FVlOtl 


FIND LOC(FCB) 




CLA 


F. 






ST A 


WRiTFUl 






STA 


OPN+1 






ST A 


CLS+1 




- 


PAC 


0,1 






Lf>! 


1*1 


FCB WORD 2 TO INDICATORS 




LFT 


OOlOOO 


EXAMINE FOR PREVIOUS ACTIVITY 




TRA 


WRITES 


PREVIOUS NOT INPUT 




LFT 


OAOOOO 


INPUT. IS FILE CLOSED 




TSX 


CLS*2 


NOiCLOSF IT 




LOl 


1 ♦! 






RIL 


003000 


SET BITS FOR OllTPriT (Oil 




ML 


001000 




ST! 


1*1 






TRA 


•+2 




WR!TF5 


LNT 


040000 


IS FILE OPFN 


WRITEI 


TSX 


OPN •2 


NO*OPFN FILF. 


TSX 


•WRlTEt* 


CALL TO Iocs 




P7e 


«• 






lORT 






WR ITY 


TRA 


FX!T 


RETURN 


flSS 


0 






SPACE 


2 






REM 


RACKSPACF FKF ROUTlNF 




<;XA 


FXlTtl 






TSy 


SAVF* 1 


SAVE ROUTINE 




TSX 


FV ! 0 f 1 


FIND LOC(Fcfl) 




CLA 


F. 




STA 


Cl.S+l 






STA 


PSKFl.l + l 






LXA 


LK.ORtA 






CLA» 




FIND NO. OF FILES 




PAX 


o»i 




TXL 


FX!T%1.0 


FXIT IF 0 




TSX 


CLS*? 


CLOSE FlLr 


TSX 


•NnSFLfA 






P7F 




BACKSPACE I FlL*=" 




Tlx 


RSKFLlt !% 1 


' '•ONTINUF FOR M FILES 


BKSFY 


TRA 


FX IT 


COMPLFTE GO HOME j 


BSS 


0 




SPACr 


2 






RFM 


OPEN ANr> CLOSE ROUTINE 


OPN 


TSX 


.OPf*N»A 






M7F ' 


«« 






TRA 


1»2 






TSX 


.CLOSF»A 






MO^ 


«« 






TRA 


1»2 






SPACF 


2 




FV!0 


RFM 


ROtIT INF TO LOCATE 


FILF CONTROL BLOCK 


CLA 




FIND LOGICAL NUMBER 




STA 








CALl 


• FvIO» l»» »F» 1 






T-A 


1.1 


-FTU-N 




SPACF 


2 






RFM 


CONSTANTS AND vARIaRLFs 




SPACF 


1 






RFM 


THE roLLOWlNC* CONSTANT IKEO tO ESTARLIsM 




RFM 


OPEN AND CLOSE PREFIX. BY SHIFTINC, 




REM 


WITH THE OE^ilREn 


OPTION CODE, THF NORMAL PRFFIxEs 




RFM 


OF -l,+2,-0» AND 


+0 CAN RF OBTAINED 




MON 






P2F 


0 




Lie .OR 


LHIP 








FND 







SI0CS096" 
SI0CS097 

siocso^HP^ 

siocslocfT 

SIOCSIOI 

siocslo? 

SIOCSIO"? 
S IOCS 106 
SIOCS105 
SI0CS106 
SI0CS107 
SI0CS108 
$I0CS109 
SIOCSIIO . 

siocsin 

SI0CS112 

siocsin 

SIOCSIU 

SIOCSI 15 

SIOCSl 16 

SI0CS117 

SIOCSI 18 

SI0CS119 

SIOCSI 20' — 

SI0CS121 

5IOCS122 

SI0CS123 

SI0CSI24 

SIOCS126 

Sl6cS127 
SIOCSl 28 

SI0CS130 
SIOCSI 31 
SI0CS13? 
SI0CSI3? 

siocsn^i 

SIOCS135 
SI0CS136 
SIOCS137 
SI0CS138 
SIOCSI 39 
SIOCSI/jO 
SIOCSU 1 
SI0CSU2 



SI0CSU3 

SI0CSU4 
SI0CSU5 
SI0CSU6 
SI0CS167 
SICCSU8 
SI0CSU9 
SlOCSI*>0 
SI0CS151 
SI0CS15? 
SIOCS153 
SI0CS15A 
SIOCS155 
SI0CS156 
SIOCS157 
SICCS158 
SIOCS159 
SIOCSI 60 
SI0CS161 

siocsift? 
siocsift-^ 

SIOCSl 6ft 

siocsie'* 

SI0CSI66 
510^.167 
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$rpMAP 


UNITS 


l7,M9A»nFCK 






KNTPY 


•UN14« 




•UNlA. 


P2F 


UN IT 14 




UN IT 14 


FILE 


♦ A(1)»INPUT»BIN»BLIC = 


410 




ENTRY 


•UN15. 




•UN15» 


PZE 


UNIT15 




UNITIS 


FILF 


♦A(2) ♦IN0UT»BIN»BLK= 


1080 




ENTRY 


•UN16. 




•UNi6« 


PZE 


UNIT16 




UNIT16 


FILE 


fA(3)»IN0uT»BtN»BLIC= 


1080 




ENTRY 


•U\17. 




•UM17. 


pzr 


UNIT17 




UNIT17 


FILE. 


♦A(4) fOUTPUTtBlNtBLK 


= 1080 




ENTRY 


•UN18. 




•UM18* 


PZF 


UNIT18 




uNrns 


FILF 


♦A(5)fO0TPUT»RlN»RLK 


= 1080 



END 
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• FNH OF FILF CARD 

X1856 92 RFCORDS BY COUNT 
$NAM1 ITAPE=1»1P=UIPD=10S 



0 


1 


2 


3 


4 


5 


6 


0 


0 


0 


0 1 


2 


3 


4 


5 


6 


7 


0 0 


'0 


1 


2 


3 


4 


5 


6 


8 


0 


0 


0 . 1 


2 


3 


4 


5 


6 


9 


10 n 


12 


1 


2 


3 


4 


5 


6 


13 


0 


0 


14 1 


2 


3 


4 


5 


6 


15 


16 17 


18 


1 




3 


4 


5 


6 


0 


0 


0 


0 1 


2 


3 


4 


5 


. 6 


0 


0 0 


0 


1 


2 


3 


4 


5 


6 • 


0 


0 


0 


0 1 


2 


3 


4 


5 


6 


0 


0 0 


0 


15 


27 


19 


17 


19 


16 


-1 


0 


n 


0 15 


27 


19 


17 


19 


16 


19 


rf^' 0 


0 


15 


27 


19 


17 


19 


16 


13 


-1 


—1 


0 15 


?7 


19 


17 


J9 


16 


\n 


35 15 


2 


15 


27 


19 


17 


19 


16 


6 


-1 


-1 


5 15 


?7 


19 


17 


19 


16 


5 


7 7 


19 


15 


27 


19 


17 


19 


16 


-3 


0 


0 


0 15 


27 


19 


17 


19 


16 


0 


0 0 


0 


,15 


27 


19 


17 


19 


16 


0 


0 


0 


0 15 


27 


19 


17 


19 


16 


-2 


0 0 


0 


1 


2 


3 


4 


5 


6 


7 


0 


0 ' 


0 1 


2 


3 


4 


5 


6 


8 


0 6 


0 


1 


2 


3 


4 


5 


6 


9 


10 


11 


0 1 


2 


3 


4 


5 


6 


12 


13 14 


15 


1 


2 


3 


4 


5 


6 


16 


17 


18 


19 1 


? 


3 


4 


5 


6 


20 


21 22 


23 


1 


2 


3 


4 


5 


6 


24 


0 


0 


0 1 


2 


3 


4 


5 


6 


0 


0 0 


0 


1 


2 


3 


4 


5 


6 


0 


0 


0 


0 1 


2 


3 


A 


5 


6 


25 


0 0 


WO_R002 


PITCH 




15 
























3»50 




3.36 




3.22 




3.08 




2.94 




2.79 


2.65 




2.50 




2.36 




2.21 


2i07 




1.93 




1.77 




1.63 




1.49 


















70. 




60. 




50. 




40. 




30. 




20. 


10. 




0. 




-10. 




-20. 


-30* 




-40. 




•50, 




-60. 




-70i 




















WORDO? 


ROLL 






27 
























5»00 




4.27 




4.12 




3.98 




3.83 




3.68 


3.53 




3.39 




3.25 




3.10 


2 #95 




2.79 




2.65 




2.50 




2.36 




2.21 


2.07 




1.93 




1.77 




1.6^ 


1*48 




1.34 




1.19 




1.05 




0.91 




0,84 


0.00 














180. 




120. 




110. 




100. 




90. 




80. 


70. 




60. 




50. 




40. 


30. 




20. 




10. 




0. 




-10. 




-20. 


-30. 




-40. 




-50. 




-60. 


-70. 




-80. 




•90. 




-100 


« 


•HO 




-120. 


-180 














W0RD04 


STICKO 




19 
























• 16 




.60 




.78 




1.00 




1.2- 




1.45 


1.66 




1.88 




2.14 




2.^6 


^•f>9 




2*84 




3.09 




3.32 




3.5/ 




3.83 


A. 10 




4.3A 




A . 74 






-U. 


9 


-lO, 




-8. 




-6. 




-4. 




-?. 


0. 




2. 




4. 




6.' 


8. 




10. 




12. 




14. 




16. 




Ifi. 


20, 




22. 




24,o 






WORD05 


STICKA 




17 
























.27 




.45 




.81 




1.11 




1,43 




1.69 


1,94 




2.24 




2.48 




2.75 


3.00 




3.28 




3.61 




3.89 




4.23 




4.59 


' 5*00 


< 












I'j. 




14. 




12. 




10. 




8. 




6. 


4. 


< 


2. 




0. 




-2. 






-6. 




-8. 




-10. 




-12. 




-14. 


-16. 














WORDO 6 


RUDDER 




19 
























.07 




.4 




.8 




1.18 




1.57 




1.78 


?.oo 




?.17 




2.40 




2.54 


2.80 




3.00 




3.20 




3.40 




3.60 




4.00. 


4.40 




4.80 




5.00 






24. 




22* 




18. 




14. 




10. 




8. 


6. 




4. 




2. 




0. 


-2; 




-4. 




-6. 




-8. 




-10. 




-14. 


-18. 




-2?. 




-24. 






W0R007 


AIRSPD 




16 
























.491 




• 7836 


.9065 


1.019 


1.152 


1.310 


1.585 


1 .864 


2.165 


2.4^e 


2.723 


3.006 • 


3.267 


3.529 


3,790 


4,025 
















0. 




60* 




70. 




BO. 




90. 




100. 


120, 




140. 




160, 




160. 


200. 




220. 




240. 




260. 




280. 




100. 
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WORD 18 
H«o6 
. -.495 
180* 
-20. 
W0PD2fl 
?.09 
0.S2 
t.O 
-2.0 
W0RD3e 
.133 
1.787 
890. 
llZOOO. 
W0RD39 
0. 

U424 

2.879 

'».?46 

360. 

260. 

160. 

60. 

W0RD40 

4.7S 

-2.165 

70. 

-30. 

W0R041 

-4.V 

-7.0 

W0Pn48 

4.86 

0. 

WOROpl 

• 23 

0. 

WCRt 58 

.39 

0. 

WORf)59 
.7 

14«28 
WORn60 
.56 
14.28 

W0Rn61 



ROLLRT 
4.13 3.595 
-1.0 -1.51 
160. l/«0. 
-40. -60. 

LATACr 
1.91 U74 

0. 36 ^•?0 

2.5 ;.o 

-2.5 --^.0 

ALTITD 
.163 .225 
2.100 2.397 
lOOO. 1500. 
14000. 16000^ 

.128 .281 

1. P67 1.711 
3.017 3.1«i5 
^•292 4.308 
350. 340. 
250. 240. 
150. 140. 
50. 40. 

YAWRTE 
4.135 3.501 
-2.87 -3.54 
60. . 50. 
-40. -50. 

NORACC 
+4.9 
♦7.0 

PLAPPO 
3.76 2.B5 
20. 40. 

THROTL 
1.72 2.76 
16. 32. 

THROTR 
1.82 2.87 
16. 32. 

RPMLFT 
1.4 2.11 
28.57 42.85 

ROMRHT 
1.12 1.69 
28.57 42.85 

PITCHR 



19 



18 



3.07 


2.545 


2.03 


1.51 


1.0 


.49 


0. 


-2.03 


-2.545 


-3.08 


-3.60 


-4.125 


-4.65 




J20. 


100. 


80. 


60. 


40. 


20. 


0. 


-80. 

t 


-100. 


-120. 


-lAO. 


-160. 


-180. 




1.57 


U46 


1.30 


1.15 


0.99 


0.83 


0*67 


1.5 


1.0 


.5 


0. 


-.5 


-1.0 


-1.5 



15 



.292 

2.689 

2000. 

isnoo. 

.404 

1.864 

3.324 

4.334 

330. 

230. 

130. 

30. 

2.84 
-4.17 
40. 
-60. 



1.90 
60. 

5 

3.72 
48. 

5 

3.85 
48. 

7 

2.82 , 
57.14 * 

7 

2.27 
• 57.14 

19 



.379 .450 

3.002 3.309 
2500. 3000. 
20000. 22000. 

.563 .701 

2.003 2.151 
3.468 3.616 
4.359 

320. 310. 

220. 210. 

120. 110. 
20. 



2.14 
-4.78 
30. 
-70. 



1.425 
20. 



1.00 .11 

80. 100. 

4.64 
64. 

4.61 
64. 

3.55 4.28 

71.4? 85.71 

2.88 3.45 

71.4? 85.71 



.647 
3.596 
4000. 
24000. 

.840 

2.305 

3.704 

300. 
200. 
1^0. 



.705 
10. 



5.00 
100.00 

4.00 
lOO.OO 



.896 1.206 
3.908 

6000. 8000. 
260C0. 

.988 1.137 

2.448 2.581 

3.91? 4.00! 

290. 280. 

190. 180. 

90. '80 ♦ 



-.73 
"10. 



1.480 
10000. 



1.280 
2.7^.0 
4,170 

270. 
170. 
70. 



-1.45 
-20. 



4.98 
-.53 
90. 

-ic. 



4.A7 

-1.08 

80. 

-2C 



3.92 
-1.635 
70. 
-30. 



FNO or FiLf: C^^RO 



3.36 
-2.21 
60. 
-40. 



2.79 
-2.77 
50. 
-50. 



2.23 
-3.34 
40. 
-60. 



1.66 
-3.90 
30. 
-70. 



1.095 
-4.45 
20. 
-8o. 



.545 0* 
-4.99 

10. 0. 
-90. 
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SUfiRCtTINE CAieRT (f^tUCRCS) 

COfn\ /Al/ Nl2fNl20tR£CCROf lUfUTtN,TAPe,INPClCCIf JCOL(lCO)t 

CO I L»:,icc 

IF CKPI ?t7,^ 

7 kCRCS(L)»0*0 
GC TC I 

2 IGC—KP 

GO TC C^t5t6f8)tlGC 

4 WORtS(L)«0*C 
WOPC«PCL) 

V0LTS»0*A051281*ABSCWQPU)-Ca256 
I? (KCRC.LT.Q.C) VCLTS»-V0LTS 

IF CVCLTS.Gt.UO) kCRDS<L)»l.O .'^ 
CO TC I. 

5 k0Ri:S(L)»K(L> 
GO TC I 

6 • PIL)»-K(L) 

C FVENT Kuf'eER P S ZZO ICO 8C ^0 2C 10 8 ^ 2 I THAT IS BCD ANO UOl 
C eiKARY CCINT 

GO TC I 

8 kORC^^FCL) 
VOLT$cC,005l28l*ABS(V*OPD)-C*^256 
IF <KCRC*LT*';.C) VCLTS*-VOLTS 
WOPCS(L)sVClTS 

GO TC I 

3 KOPl»PCL> 

V0LTS«C%0C5 126 PAHS(^<OPD)-C* 1256 
IF CWCRC.LT.O.C) VCLTS«-VOLTS 
J«JCCl(l) 

CALL AITKEN (X^RR AY ( I , J ) ♦ YARRAY U t J ) t VOLU, WORDSC L > tOIF ,51 1 NP , I ,Kl 
It JJ) 

I COKTIKt: 
R€TIRN 
ENC 
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GLTHttE 07/14/65 
AITKN - SGUKCE STATEMENT - IFN(S) - 

SUHKCtTINE iilTKEN ( X^Y »XI »Y I »0I F tN, r4»!NT t K 1 1 J > AITKNCCI 

C AITKNv.2 

Clf ENSICN ,Y(M),XX(ll»,YY(ll),CIFF(ll» AITKNC03 

C CECK TC CROP THE FIRST BAD POINT FROK =ITHcR SIO? AND CONTINUE AITKNCC4 

C HsMAXIf't'^ CIMENSICN OF X ANC Y VECTORS AITKNCi,5 

C N=NUMPER CF PCI.NTS IN THE X AND Y VECTOR*; THIS CALL AITKNC^6 

C LEFT ANC CHA^G^ (LftS=i) RIGHT ANC CHANGE CLRS=2) AITKNC,7 

C LEFT ALWAYS' (LRS>3) RIGHT ALWAYS (LRS»4} AITKNCC8 

C X=A 5 6 7 8 XI-S.5 K WOULD BE 2 AITKNC:;9 

C PARAfSTEftS AITKfjClu 
C X = I^CEPE^OE^T variable Y^OEPENCENT variable Ns^NUMBER POINTS AITKNOll 

C Xl=GIVEN X YI^REQLIREC Y AITKNC12 
C Kl=POSITICN CF THE LEFT MCST X USED J=THE NUMBER OF POINTS USED AITKNC13 

C AITKNCl^ 

INTEGER L AITKNCI3 

J=r AITKNC16 

CIF=C*C AITKNCI7. 

CIFF< 1)=1*CE37 AITKNC18 

Kl= AITKNC19 

YI=0*C AITKN020 

IF (N.GT.l) GC TC 9D AITKNG21 

WRITE (6t4) N AITKNC22 
4 FOR^'AT (3HCN=»I12,2X,5CHTHERE ARE LESS THAN TWO POINTS IN THE (X,YAITKNG23 

1) TARL5.) AITKNC24 

CALL FXEM AITKNC23 

90 IF (X( n»GT.X(N)) GO TC 1900 AITKNC26 

IF (XI-X(l)) 5U«,6iv,BC0 AITKNC27 

500 K=l AITKNC28 

LRS=4 AITKNC29 

GO TC 2a'^0 AITKNCiO 

6C0 Kirl AITKNC31 

YI=Y(1) AITKNC32 

«IFTCRN AITKNC33 

SCO IP (XI-X(N)) 12CC,900,1100 AITKNC34 

900 Kl^N AITKNC35 

YI = Y(M AITKNC36 

aETLRN AITKNC37 

HOC K=^ AITKNC3d 

LRS=3 AITKhC39 

GO TC 2800 AITKNC4C 

120C LL=1 . AITKNC41 

LU=N AITKNC42 

130C IF ((LU-LL)*EQ.I) GO TC 1400 AITKNC43 

LI=(LU+LL) /2 AITKNC44 

IF (XI-X(LI)) 1800, 170C, 1600 AITKNC45 

160C LL^LI AITKNC46 

GO TC 1300 AITKNC47 

170C K1=LI AITKNC48 

YI=Y(LI) AITKN049 

RSTLRN ' AITKNC50 

180C LU=LI AITKNC51 

GO TC 1300 AITKNC52 

190C IF (XI-X(l)) 2CCC,600,500 AITKN053 

2CC0 IF (XI-X(N)) 1100,900,2100 AITKN054 

210C LL=1 AITKN055 
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22CC 

2«0C 
250C 
lACC 
280C 



2<J0C 
3C0C 



58C-: 



37CC 
380C 
390C 



4C0C 



41CC 



^3CC 



450C 



3 
I 



LU = f. 


Mi 1 IXilU^O 


IP ((LU-U) .PC.ll GO TC 


••41 "VI^V ^ f 


Ll = (LL'»LU)/? 




IF (XI-X(LI)) ?^C'},l70Cf 25C.> 


At IKfiC" 


LL = LI 


A I TKNr A*'i 


r,C TC 3'?: 




LU=LI 


AI TKN' 62 

* > r\ 11 w V & 


GC rc 220: 


AITKNC6') 


K = LL 


AlTKNCfi4 


L«S=2 


. AITKWC65 


Kl=K 


AT TKHCf(% 


IF (INT.tC.C) SHTURN 


AI TKNC67 


IPj: -r 


AITKN068 




AITKNG6Q 


YY( J)rY(K) 


AITKNC7S 




AI TKNC7I 


J=J'»l 


AITKNG 72 


ir (J.fiT.ll) GC TO 5B.:C 


AI TKNC73 


IF (J.te.M GC TC 3700 






AT TKMr'*^ 


Yl=YV{J) ■ 


AT TKNf 7(% 


CIF=CIFF{J) 


AITKNG77 


^tTURN 




GC TC (?<iCCt^i:Ct J9C0f A2C0)fLRS 




LftS=2 


AT TKM'^Hii 




AT TKf^r P • 


IF (K.GT.C) GO TC ^500 


A T TK^Vf ftx 


IF CLHS.FC.3) GC TC 5«v"i 


AITKNCfc3 


K=K-»IPS 


AITKNl^4 


L?S=A 


AITKNCB5 




AITKNCd6 


GC TC 37** 


AITKNC87 




AITKtNCdB 




AITKNi.e9 


IF CK.Lr^.M GQ TC 45v0 


AITKMC90 


IF CIKS.CC.^) GC TC SBCi 


AITKNCSl 


KsK-lPS 


AITKNC9Z 




AITKNC9>-* 


IPS = 1 


AITKNC94 


GG TC 3700 


AITKNC95 


XX( J) = X(K)-XI 


AITKNC96 


YV( J)=Y(K) 


AITKNC97 


LO=J-l 


AITKNC98 




AITKNC99 


Ti=>x{j)-xxcn 


AITKMCO 


ir CTl.NE... ") GC TC 460: 


AITKNIOI 


WPITE {f»3) 


AITKN1C2 


FO«^^AT i^7l-^CIVIStCN BY /rRC IN AITKrM) 


AITKfaC3 



FHRf AT (lKCtIP^2':.6,2IlO/lX/(LX,lP2E20.6n 

CMl FX^y 

YY{ j) = { (YYd )*xx( j))-(YY( j)«xx( nn/Ti 

CIFr{J) = ABS{YY{J).YY(J-lM 

IF CCIFF(J) .GCCIFFCJ-m GO TO 597-. 

IF (X.L^.KI) K1=K 

IF (2-LRS) 3^>:,29-:^t29o: 



AITKNI-.4 
AITKMCS 
AITKNIJ6 
AITKNi:^7 
AITKN108 
AITKNIC9 



123 
124 

13C 



UThRE :-7/l4/69 
AITKN - EfU SCURCe STATEMENT - IFN{S) - 



285 



I 



AFHRL-TR-72-6 



APPENDIX IV 
FORTRAN PROGRAMS FOR A SAMPLING RATE STUDY 



ERIC 
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03/26/70 

RESOLV - EFN SCUKCE STATEHENT - IFN(SI - 



OIMENSICM ARAY(9700I 
OIMFNSICN TEP«^(12I 

OrHFMSION A( 120,9 I f 3( 12 »25) ,EVNO( 501 ,XCNT(50I fOELUO) 
DIMENSION AQXZ(50f 1CUAR(50»10,12) ,flPTCT(5C| 
DIMENSICN lRTF(SOI,SUHtl2l 

CO^KIN A^ A>,OELTA ,V,RFSrL,CCl.NIT,W,TKEEF,L 
CCMi^DN TERP 

REAC( 5,5')CIN,M,IMCM,inAY,lYR 
WRlTE(6,lCC0nMCN» ICAY, lYR 
WRITE(6,10C3I 

f=0RMAT(13H VAR IS PITCH/IH /) 

REAC( 5, 501 MEVNnC n,I = l»NI 

REAC(5t5ai)(XCNT( n,I = l,N) 

?^EAC( 5,5^2MDEL( I >»I=Uf'l 

REA0(5,73CMI^?TP( I),l = l»N) 
73^* FORMAK 1415) 
5^1 FGRMAT(5I5I 

5r^2 FORMATt 12Ft.2) 
5'>3 CQRMATt 8F8.A) 
WRITE(6,10C1) 
00 20 I=l,^ 
22 REAC( 16)( ( A( IY,JY I , IY=1 ,12C) ,JY = 1 ,9) 
^EAO( I6lt (8( IY,JY K IY = I»12I ,JY = 1,25) 
pn 21 J=l , 12 
^l(=A»'00tB( J,18>,10C.CI 
IFCEVNOd I-XI21,3,21 
21 CCNTINUE 
GO TO 22 
3 IA=1 

?-) RFACt 16M ( A( IY,JY U IY=1,120) ,JY = 1 ,9) 
^>EAO( 16M (3( IY,JY ), IY=1 ,121 ,JY = U25) 
OG S K=l, 120 
IF(K-n 101 tlOltlOC 

10-^ iF( A(K,6neco,aoufici 

8^1 IF( A(K,6)-25C. 1802, 802f 600 
8'^2 IP(ABS( A(K,2n-36C, ) 603, 803, 800 
803 IF(B(K,6I I8C0,8C0,1C1 
800 ARAY( IAI = AR£Y( IA-1) 

GO TO S 
101 ARAY( I A) = ,^(K, 1 ) 

5 IArIA+1 
X=IA/1M 

IF(X-XCNT( I) )30,6,6 

6 IA=IA-1 
RESCL='^. 
WRITE(6,1C10) 

nn pnRVAT( ih /i 

r»-i 50 K=l ,v 
Ol.TA=0.01 
V=OEL(K) 
L^IA 

CALL TSTRF 

n'^^ FOR'^ATC 1HI,5X,3?HSAMPLING ANALYSIS FOR FLIGHT CF 1 2 , IH-I 2 , IH- 12/ 
11 H /) 
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RlrSOLV - EFN SOURCE STATEMENT • IFN(S) - 03/26/70 

1001 FORMATdH 1 5X t AHS AMP, ?X , 3HNC . , 6X, 1 IHTI KES kORST/32H EVNO RATE SAMP 
1 RES. EXCEC. ERRtAX,AHTIMEf 2X,^H0-.5,1X,66H.5-1. 1-1.5 1.5-2. 2-2 
2.6 2.5-3 3-3.5 A-5 5-10 10-20 GR-20/1H /) 

WRITE(6,ICC2)EVN0(T » t V» L tRE SCL , COUNT, H , TKEEP , (TERR(KL ) ,KL=1, 12 ) 
inn? FORKAT(F4.0,l=6.2, 15 ,F5 . 1 ,F6 . 0, F3. 3 , Ffc . 2, 1 2F6. 0) 
ARXZC UK)=COUNT 

AR(I,K,1)=TERR(1) - - 

DO 600 KL=2,12 

KM=KL-1 

600 ARC UKtKL )=ARC I,K tKHUTERR(KL) 
50 CCNTINUE 

ARTCT(n = L 
?0 CCNTINUF 

DO €02 1=1, N 

no €02 J=1,K ^ 
00 601 K=l,12 ' ^ 

601 ARC I,J,K)=AR(I,J,K» /ARXZd t J) 

602 ARXZCItJ)=AR)CZ(I, J)/ARTCT{I) 
WRlTEC6t6C3 ) 

00 605 1=1, N 
WRITE(6,6C7» 
DO 604 J=lt« 

WRITEC6,6G6)EVN0( 1) ,OEL ( J ) , ARXZ ( I , J ) t ( AR ( I » J , K ) ,K= 1 , 12 ) 

604 CONTINUE 

605 CONTINUE 

603 FORf^ATClH /IH /6H EVNC t 4X 1 3H0EL, ^X ,4HGT C,^X, 
15HLE .5,3Xt5HLE l.t2X,6HLE 1.5,3X,5HLE 2.t 

22X,6HLE 2.5,3X,5HLF 3.t2X,6HLE 3.5t3Xt * 
35HLE 4.,5Xt5HLE 5.t2X,5l-LE 10, 
43X,5HLE 2C,3Xt6HLE INF/IH /) 

606 FORMATC F5 . C ,2X ,F6 . 2 ,2X » F6. 1 1 2X , 12 ( F6.3 ,2X ) ) 

607 FORMATC IH /) 
00 750 LMsi,3 
00 752 J=ltM 
WRITE(6,6C7) 
00 751 LX=1,12 

751 SUM(LX)=0. 
DO 753 I^ltN 
TMT = IkTFC I S 
IFCTMT-LM)753t754,753 

754 00 755 K=l,12 

755 SUMCK)=SUMCKJ+ARC I, J,K) 

WRITEC6,6C6)EVN0( 1) ,DEL ( J » , ARXZ ( I t J ) , C AR ( I , J , K ) ,K = 1 1 12 ) 
753 CONTINUE 

WRITEC6,7 8C XSUHCK) ,K=1 1 12) 
780 F0RMATC23X,12CF7.3» IX)) 
75? CONTINUE 
750 CONTINUE 

STOP 

END 
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03/26/70 

TST - EFN SOURCr STATE^'ENT - IFN(S) - 



SlifJ«nUTINE TSTRE 
OI^FNSICN AKAy(97C0> 
niMENSICM TFPR( 12 ) 

CCM^ON AHAY,nELTA,V,RESCL,CCLNT,W, TKEEP,L 
rnMMO«^ TFRR 

no 1 1 = 1,1?. 
I TE^p(n=o. 

ANUM(n=0. 
00 2 1 = 2,8 
7, ANUV( r>=ANt^( I-IM.5 
ANU^OI^-V. 
ANUW( IC > = 5. 
ANU><( 11 >=10. 
ANUy( 1?)=20. 
ANUM( 1? >= 10000. 
TKEEP=- 1.0 
W=- iron . 
'^=V/.nELTA 
CCUNT=0.o 

LPT= L-V 

00 20 J=1,LET,M 

P!=ARAY(J| 

KT=J+M 

£>2=ARAY(KT ) 

0M«=J-1 

T1=CMR%0ELTA 

OMtt=KT-l 

T?=CMR*OELTA. 

XML = (P2-Pn/(T?-TU 

XLS=P1-XML*T1 

KAX = J<'1 

KAY=JfM-i 

00 Ar=KAX,KAV 
nMR=I-l 

T = Cf<R*DELTA 
TCST=XML*T*XLS 
X=ARAY( 1>-TEST 
X.X = ARS(X)-RESCL 

1 F( XXKf4,5 

5 CCUNT=CCUKT*1.') 
00 3 K=l, 12 
IF(XX-AMjy(K)n,3f30 

•^0 lF(XX-ANU>'(K*in32,32,3 
32 TERR(K)=TERR(KK1 .0 

3 CCMTINUF 
IF{XX-WKf6»6 

6 WsXX 
TKEEP=T 

4 CCNTINUE 
20 CONTINUE 

HETUPN 
END 
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APPENDIX V 

EXTENDED ANALYSIS OF" THE NORMAL LANDING TASK 
J. F. Hixson, Lt Colonel, USAFR 
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1. INTRODUCTION 

Measurement analysis of the 360^ overhead traffic pattern involves a 
sequential examination of the individual and combined aeronautical and 
procedural skills incorporated in this maneuver* For purposes of 
interpretation of data and analysis of skills involved, the flight 
maneuver is broken into eight phases. This maneuver conforms to the 
360^ standard overhead pattern for the T-37 as outlined in ATC. Manual 
51-4, (Reference 4). 

The eight phases are as follows (See Figure A): 
lA Entry 

IB Approach to Runway (Overhead) 

II Initial Overhead to Pitchout 

III Pitchout and First Quarter Turn toward Downwind (O^ to 90^ 
turn) 

IV Second Quarter Turn to Downwind (90 to 180^ turn) 

V Downwind 

VI First Quarter Turn to Final (180 to 270"" turn) 

VII Second Quarter Turn onto Final (270 to 360 turn) 

VIII Final Approach 

2. DISCUSSION OF MANEUVER SEGMENTS 

a. Phases lA and B, Entry and Approach Phase of Normal 
Overhead Pattern (See Figure B) 

The student discerns a heading that is 45^ to the heading of the 
active runway (the runway to be landing on). He approaches the field on 
this heading at an altitude of 1000 feet; airspeed 200 knots; RPM 80% 
(approximately) V a point where his 45^ turn will place his aircraft on 
a flight ^th that will begin at least two miles from the approach end of 
the active runway and on a ground pattern that would describe a line 
directly down the center line of the runway. 
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Figure A. Task Segments for 360° Overhead Landing Pattern 



AFHRL-TR-72-6 

b. Phase II, Initial Overhead to Pitchout Phase of 
Nonnal Landing (See Figure C) 

The student maintains an altitude of 1000 feet; 200 knots; 
RPM 80%, to a point at least 3000 feet beyond the approach end of the 
runway, and not beyond the halfway mark of the runway. Some where 
withlin this region the student executes his pitchout. At pitchout, he 
banks the aircraft (not oVer 60'') and retards his throttle setting to 
one of 50-60% RPM while maintaining pattern altitude (1000 feet). 

c. Phases III and 'IV, Pitchout, First and 
Second Quarter Turns to Downwind of Nonnal 
Overhead Pattern (See Figures D and E) 

The pitchout initiates a continuous 180** turn by the student, 
with consideration given to wind conditions. When properly executed, 
rollout will be accomplished at a point even with the pitchout 
initialization point and on a parallel path to the active runway. This 
part of the flight path is called the downwind leg. Throughout this 
turn, an altitude of 1000 feet is maintained. Additional back pressure 
(hence trim) is needed to maintain the altitude because of the decrease 
in the power setting at pitchout (50-60%). 

d. Phase V, Downwind Leg of Normal Overhead Pattern 
(Figure F) 

As rollout on the downwind leg is accomplished, the student 
lowers the speed brakes to reduce the airspeed to 150 knots or lower. 
As the aircraft passes below 150 knots, gear is dropped and airspeed 
continues to drop off. Throughout these operations, an altitude of 
1000 feet is maintained and increased power setting may be necessary to 
hold airspeed and altitude. . An altitude of 1000 feet is maintained 
throughout the landing pattern through the point of flap lowering. At 
no time on the downwind is the airspeed permitted to drop below 120 knots. 
(Increased power setting may be necessary as drag increaes to maintain 
airspeed and altitude.) 
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Pitchout Point- 



Altitude iOOO ft 
Airtpttd 200 kt* 

nPU 80% (Approx.) 



Nlort Thon 3000 ft Out 
L«ts Thon Hoifwoy 
Down Runwoy 



Figure C. Initial Overhead t.o Fitchout Phase of 360' Overhead Pattern 
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Attitudt 1000 ft 
Airsptttf DaerMtin^ 
From 200 Kts 

RPM so-eo% 
Bonk s eo« 



Figure D. Pitchout and l«t Quarcer Turn Phase of 360* Overhead Pattern 




Altitude 1000 ft 
Airtpeed OecftotiAg to 

ApPfOJK. 150 Kts 
RPM 50-60% 



Figure E. 2nd Quarter Turn to Dovmwind Phase of 360** Overhead Pattern 
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Altitud* tOOO ft 

RPM 90 - eo % 

Airspvtd: 

Point A: UnClfir 200 Ktt 
Point B: 190 Ktt or Btlow 
Point C: 139 Ktt or Btlow 

Minimum Airtpttd on 
Downwind LtQ 120 Ktt 



i • B- 



A'^xttnd Spttd Brokts 



Exttnd Londing Gtor 



■i ' C— Lowtr Fiopt 



U 0 



Inltlott Turn Onto 
Finol To Provldt 
Rollout -jr Milt Prom 
End of Runway 



Figure F. Downwind Phase of 360° Overhead Pattern 
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e. Phases VI and VIII, First and Second Quarter Turn to 
Final Phase of Normal Overhead Pattern (Figures G and H) 

A descending turn is initiated with a decrease in airspeed to 
110 knots. The student takes into consideration the wind and distance 
from the runway so that rollout will be made at a predetermined position 
at least one-half mile from the end of the runway with an altitude of at 
least 300 feet. At no time is the bank to be over 45^ or the airspeed 
to be less than 110 knots. 

f. Phase VIII, Final Approach Phase of Normal 
Overhead Traffic Pattern (Figure I) 

The student will rollout on the final approach at least one half 
mile from the approach end of- the runway at an altitude of no less than 
300 feet. The rollout should be at such a heading as to result in a 
ground path in line with, the runway. Airspeed is lowered to 100 knots 
during the final approach and letdown. 

3. NARRATIVE DESCRIPTION OF THE 360° STANDARD OVERHEAD 
TRAFFIC PATTERN AS OUTLINED IN ATC MANUAL 51-4* 

Entry into the landing pattern is initiated at a 45° angle to the 
active runway. All turns in the maneuver are in the same direction, 
depending on whether the pattern is a right or left hand pattern. Initial 
pattern altitude is 1000 feet and pattern airspeed is 200 knots 
.(approximately 80% RPM). 

Initial leg of landing pattern is in line with and over the center 
line of the active runway. 

After a position between 3000 feet from the approach end of the 
runway and one half of the runway is reached, oitchout is accomplished. 

throughout the entire flight pattern, the student will be expected to 
execute coordinated flight maneuvers and evidence a smoothness in the 
execution of procedures. Proper clearing of area,* adjustments for 
wind, traffic, and understanding of necessary cockpit procedures are 
assumed within the realm of capability and understanding of the student, 
as well as the expected procedure for the 360^ overhead standard pattern. 
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Altitudt 1000 ft| Btgin Descent 

Airspeed Between 120 and 135 
Kts, Decreasing to 110 
in Turn 



Bank < 45^ 



Figure G. 1st Quarter Turn to Final Phase in 360° Overhead Pattern 



Altitude 300 ft ot Rollout 
Airspeed 110 Kts 
Bonk < 45"" 



Rollout Onto 
Final ot Uost 
-^Mite from 

Runway 



Figure H. 2nd Quarter Turn to Final Phase of 360* Overhead Pattern 
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This constitutes a nearly simultaneous bank in pattern direction, and 
reduction of power to between 50 and 60%. (If one is to precede the 
other, bank should precede reduction in power.) The bank is not to 
exceed 60°. 

In maintaining pattern altitude of 1000 feet, there is a continuous 
180° turn designed to bring the pilot out on the downwind leg position 
of the pattern. The rollout for downwind should be accomplished 
approximately in line with the pitchout position to initiate a ground 
pattern parallel to the active runway. During the turning interval, ■ 
the pattern altitude of 1000 feet is maintained as airspeed decreases, 
due to the reduction in power. 

After the rollout on downwind is accomplished, speed brakes are 
applied to bring the airspeed down to 150 knots or below. The aircraft 
should be approximately one half of the way on the downwind leg. Gear 
should be dropped at this point, continuing the reduction of airspeed 
to 135 knots or below (never below 120 knots). Pattern altitude of 
1000 -^eot above the terrain should be maintained at all times. Power 
necessary to maintain airspeed and altitude should be used. 

Wing faps should L iropped prior to initiating turn that will 
bring the aircraft out on final approach. THIS SHOULD BE DONE WHILE 
AIRCRAFT IS STILL IN LEVEL POSITION, AIRSPEED LESS THAN 135 KNOTS, BUT 
NOT LESS THAN 120 KNOTS, AND ALTITUDE STILL 1000 FEET. 

Initiate continuous turn onto final approach; bank- is not to exceed 
45°. Nose is lowered to begin descent, and airspeed is decreased to 
no knots in the turn. Turn and descent is judged to permit aircraft 
to rollout on final approach at least one half mile from the end of the 
runway at an altitude of NOT LESS THAN 300 FEET. 

A straight descent is maintained until touchdown. Airspeed is 
decreased to 100 knots for final approach. 
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4* Skills Required 

Mastery of the 360** Standard Overhead Traffic Pattern is 
mandatory prior to a student's ability to fly an aircraft solo* The 
skills "involved in this maneuver will have been presented ihe student 
as individual skill techniques prior to accomplishment of the landing* 
pattern. Measurement of the basic skills are of prime importance in 
ascertaining proficiency. The skills in mention, and the areas of the 
maneuver in which they are employed, are defined as follows: 

Directional Control . The skill of being able to determine and 
maintain a heading, determine and maintain proper ground track depending 
on wind conditions, rollout on a predetermined heading from varying 
degrees of bank from level, and ascending or descending flight. 

Altitude Control. The skill of being able to maintain altitude, 
level off at a predetermined altilude either from a climb or descent; 
maintain altitude with varying airspeed or with varying degrees of bank, 
and in a rollout from a banked turn within varying degrees of bank. 

Airspeed Control. The skill of maintaining a desired airspeed, 
or establishing a desired airspeed, the ability to change an airspeed, 
then establish the attitude to hold the airspeed as in a descent, or 
the skill to establish the attitude to attain a prede|;ermined airspeed. 

Rolling Into and Maintaining a Desired Bank (Without Varying). 
The ability to make a coordinated turn without varying airspeed or 
altitude, and the ability to roll into and out of this turn without 
over-controlling. Also, the ability to rollout onto at a predetermined 
heading. 

The skill-^composites and knowledges that need to be considered for 
measurement are: 

Straight and Level Flight. The ability to maintain the aircraft in 
straight and level flight involving the maintenance of heading and 
altitude* 
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Level Turns.., The ability to make a coordinated turn without losinc 
altitude or over-controlling to maintain proper bank. 

Descending Turns. The ability to maintain the proper airspeed, 
bank, and rate of descent without excess banking. 

Maintenance of Altitude at Varying Airspeed or Power Setting. The 
ability to maintain a given altitude while varying the power setting. 
In the traffic pattern maneuver, this involves reducing the airspeed 
while holding altitude. 

Straight Descent. The ability to maintain directional control of 
the aircraft while losing altitude at. a given airspeed and a constant 
glide angle. 

Varying Degrees of Bank. The ability to coordinate a roll into the 
desired bank and maintain this bank without loss of altitude, unless so 
desired. Also, the ability to determine and hold a prescribed degree 
of bank. 

Ability to Judge Rate of Turn. The ability to predetermine the 
position to initiate a given rate of bank, or alter a rate of bank 
within limits in such a manner that the rollout places the aircraft on 
the desired ground path. 

Ability to Rollout Onto a Desired Heading. The ability to place 
the aircraft on the desired heading after completion of a turn. 

Ability to Determine Wind Drift and Angle. Basic knowledge of wind 
and wind drift angles that permits rolling out to a predetermined heading 
that will effect the desired ground path. 

Knowledge of Procedures. Basic knowledge of aircraft procedures 
for landing and for the landing pattern that will produce desired changes 
in airspeed, altitude, direction, etc., at the prescribed position 
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in the landing pattern are essential to accomplish the landing pattern 
as prescribed. 

The student is expected to execute coordinated flight maneuvers and 
demonstrate a smoothness in the execution of procedures throughout the 
entire flight pattern. 

5. PRELIMINARY PERFORMANCE MEASURES FOR THE 
NORMAL OVERHEAD 360^ TRAFFIC PAHERN 

Patterns will present different profiles because of the different 
procedural requirements due to such variations as single engine landings, 
touch and go landings, right or left hand patterns, and patterns 
executed with varying degrees of flaps. In general, measures should 
address at least the following parameters: 

Altitude. Measurement of how well the pilot's altitude compares 
with ATC criteria throughout the maneuver. Measures ability to maintain 
altitude through different power settings, while accomplishing cockpit 
procedures. 

Airspeed. Measurement of how well the pilot remains within the 
ATC limits as he follows the normal procedure for the landing pattern. 

Degree of Bank. Measures the pilot^s ability to accomplish a 180"" 
turn without exceeding a given maximum bank, and his ability to judge 
the necessary angle of bank needed to complete the turn within a certain 
area, rolling out at a prescribed position on a definite heading* 

Vertical Velocity. Measures the ability of the pilot to transition 
from level flight attitude to a descending attitude and to anticipate the 
required rate of descent. 

Attitude. Determines the pilot •s ability to hold altitude by 
changing the attitude at different power settings. 
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RPM> Measures how well the pilot conforms to ATC standards and 
procedures throughout this maneuver for either normal or single engi 
performance. 
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APPENDIX VI 
EXECUTIVE PROGRAM FOR LAZY 8 

This program reads the calibrated data, performs 
basic computations (estimated ground speed, 
altitude-change, and degrees of turn), prints 
data at a sampling rate of 2/second, calls the 
measurement subroutine, and generates plotting 
data. 
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KNiiOP 

LAZYVa - CF.N SOURCE STME^ENT « IfHiS) 



CPRP4T MciSUft^ VARIABLES FUR LAZY 6 MANEUVER 
OIM'.NSION AR( I0t33o) 
OIMcNSlON A(l20,9)'»y(l2t25) tFVN0C25) 
DIMi:NSin?i XCNT(25) 

DIM NSIHN ZX(l20)tZY(l20)9nATA(43B) 

COMMON AR,L 

CALL PL0TS(0ATA»438) 

CALL PL0T(O.0tO.3t-3) 

I COUNT*. 

fHV=.l 

READ i3»SO0) N 
READ (^t50n (EVNO(ntl'lfN) 
601 READ (5»S0n ( XCNT ( I ) 1 1* I tN ) 
ITEST«-10 

1 READ(I6) ((A(I ,J)tI«ltI20)tJ«lt9) 
^EAi>(I6) ( I »J)t 12)tJ«lt25) 
DO 20 I»lfl2 

X«A^^0U(Q(Xtiai tlOO.O) 
IF(=VN0(ieV)-X) 2f3t2 

3 IFdTEST) ^,5t5 

4 WRIT-: (6,3C0) £VNO(I£V) 
L«0 

T!Mi«0.0 
IT£ST«0 

5 IA«10*CI-1)*\ 
L«L*l 

AR(UL)»A(IA,2) 
AR(2tL)«A(lAtI) 
AR(3tL)«B(If7> 
AR(^tt)<B( It6) 

AR(5a)=A(lAt6) ^ 

AR(^»L)«e( Iil5) 

AR(7»L)»B(ItI6) 

AR(dtL)«A(IAt3) 

AR(9»L)>A(lAt4) 

AR(10»L)*D(l,9) 

ANL=3.14139?65*AR(2,L)/180«U ^ - • 

SXLKsSr^CANL) 

CXLk«C0S( AND 

ALTX=:SXLR*AR(5tL)*A080.0/36J0.0 
GS»CXLK»AR(5»L) 
TURN=ABS(AR(3»L)-AR(3tl)) 
IF(ICCUNT-4) 20l»200,20l 

200 WRITE (&t301) TIME t A( Ut 2 ) t A( I At I) t & ( 1 1 7 ) , 8 ( I • 6) , A( I At6) t6( 1 1 15 ) t 
IB(Itl6)»A(IAt3)tA(IAt4)tTURNtGSf ALTX 

TIMtsTIME + O.'J 
ICOUNT«0 
GO TO 600 

201 I COUNTS I COUNTS 1 ? 
GO rO 600 

2 IPdTEST) 20»7t7 
7 CONTINU: 

CALL EIAZY8 
ftEAG(5,500)IVPL0T 
IP(iVPL0T)7b0f 82»B2 
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LA^YVa • tF.M SUURCc SUrEMEUT - IFN(SI - 10^13/69 

CSTART PLuT RuUTI.*4^= 
82 KK-r 

KK=KK*l 

90 ZY(KK»r%p(2» IK) 

CALL SYMB0L(-O.6»-Ul.C.l,^5HR0LL VS« PITCH FjR LAZY 8.0,25) 
CALL SCAL5J/X,lO.O,KK,l, lO.O) 
CALL SC:LE(7Y,9.0»KK,1,10.0» 
CALL LPl«:(ZX,/YtKK,l,ian 

.^?J;^..t^^^^''^*^*^*^*^'^"^^^'- ^^EGR:=S).-U.IO.O.O.O,ZX(KKUI.ZX(KK*2) 
CALL AXIS(0. 0,0.0. 15HPITCH (OEGftEES )• 15,9. 0.90. C*,ZY(KK*U,^Y(KK42) 

1 9 10.0) 

ZX(U.O. 
ZX(?»s40. 

zx(:»«eo. 

ZX(4»=^0. 

ZX(:«)»:, 

\MXs0.O 

00 ^1 LAsl'.KK 

V»ABS(ZY(L4) » 

IF(V-A^.X»9l.9l,92 

92 AMX=V 

91 CONriNU^^ 
ZYCUaO. 
ZY(^»«^MX 
ZY( 

ZY(A Js-AMX 

ZY(.v».0. 

00 LAS6.10 

LR-l.A-5 

ZX(LAJ*-ZX(Li^» 

93 ZY(LM=ZY(LB) 

zx(] n^zxcKK^n 

ZX(1?»r^X(KK*2) 

ZYdn^ZYCKK*!) 

ZY(12»=ZY(KK*2) 

CALL LlNECZX.ZYtlO.UO.O) 

CALL PLOT(l2.CfC.0.-3) 

KX = ' 

'/^ IK=I.L.IC 
KK=KK*l 
ZX(^K^=KK 

94 ZY(KK>='R(1,IK) 

^^''''^'^^'^-^•^•^••^•^•"♦ItJ'tHitaLL A,*n PITCH VS. TIME FOR LAZY rf^Ot 

CALL SL:.LE(ZX.lO.0.KK.l.lO.:«) 

CALL SCALE(ZY.9.0.KK,1.1C.C) 

CALt LI i/(;xtZY.KK.ia.in 

CAU AXISCj.O.J.O.IhHTIMH (S£CONOS).-14.10.0.0. )♦ ZX ( KK* U ,ZX (KK*;? ) 
1.1 ' • ' I 

CALL AXlS(0.0f3*O.7HOEGRE£S.7,9.0.9G.0,ZY(KK*l|,7Y(KK*2l,10.O) 

00 IKsl.L.lO 
KK=KK*i 
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KfirOP 10/13/6V 
L*.ZYYU - cPN Snu^^Cc STi^TCMcMT - IF'4(S) - 

95 ZY(KK )s^K(2tlK) 

CALL LlV'UX,ZY,KK,l,l,l) 

CALL SYMftOL (B. 0,8.^,0. I tAH«OLL,0,<i) 

C^Ll SY.MROL(8.7f8.a,0. It llfOt-l) 

CALL SY'^PaLCB^OtB.StvT.ltSHPITCHtOtSI 

CALL SY.VBOL(ft.7,a. -5,0. It l»0,-n 

KK*c 

03 V6 iKJ'ltLtlO 

96 7Y(KK) = .\P(*.,IK) 

CALL PLC.T(l?.G»0.0»-3) 

CALL SYr.f\0L(-0.6,-l.lf 0.l»2fjHALTlTUu£ VS. TIXc FOR LAZY 8,0t28) 
CALL SCiL£(^Y,9•0,KKtltlO.C■) 
CALL LlN£(/XtZY»KKtltltll) 

CALL "AXlSCC^OtO.OtlAHTlM- ( SECONDS) t -14t 10 .0,0. O^ZXCKK*! ),ZXCKK*2) 
Itl 3*0) 

CALL AXIS (O.Ot 0.0, l-t.ALTlTUl;e (Fc£T ) 1 1 5f 9. 0 ,yO»0» ZY ( KK* 1) , ZY( KKt2 ) 
UIO.O) 

00 V7 lK=l,LtlO 

97 ZY(KK)s£R( >,IK) 

CALL t>LOT(l2.0,O.Dt-3) 

CALL SYM.«UL{-0.f>»-l.l,0.1,23HAlRSP^cD VS. TIME FOR LAZY B,0t2d) 
CALL SCALi(^Y,9.0tKK,ltlO.O) 
CALL Lr^E(ZX,ZY,KK,^l,i,ll) 

CALL AXIS(0.0,0»0» l4MTIMt ( ^SwONOS) t-l A» lO.OtO.OtZX (KK^l) ,ZX(KK42 ) 
1,10.0) 

CALL AXIS (0*0, 0.0, l6HAlRSPZ-iO (KNJT^)t 16, 9 • 0, 90.0, ZY(tCK*l ) t ZY (KK*2 
1)«K«0) 

DO 9y IK=1,L,10 

98 ZY(KK) = r.K(^,lK) 

CALL PLGT( 12.0,0.0,-3) 

CALL SYVBQL(-C-.6,-l.l,C'.l,if/HHSADlNr, VS. TlHE FDR LAZY 8,0,27) 
CALL SCiLt(/Y,9.0,KK, 1,10.0) 
CALL L2.;V(ZX,ZY,KKa,l,ll) 

CALl AXIS (•>. 0,0.0, UHTIMc < S^tCO^JDS) , -U, 10. 0, 0.C, ZX( KK* I ) , ZX( KK42 ) 
1,10,0) 

CALL AXIS (CO, 0.0, nHH-.ADL^a (OHGX: . S ) , 17, 9 .0, 90. 0,ZY ( KK*l ) ,ZY(KK4 
12) -10.0) 
CALL PL'3T< 17.0,0.0,-3) 
7X(l)sO»C 
ZYCi)*0.0 
KKsJ 

DO oO lKxUL,lO 

ANGi. = =:3aAL*592o5*/4H( 3, IK)/l&C. 
SXX = Si:i(A*^GLP^ 
CX<=COS(AWGL") 

AM'3f,= 3.l4lb9265*A;^(2,IK)/P^O, 
CS='*'fi(5,IK)*C0S(ANCB) 
2X(KK)-/X(KK-l )*GS*SXX 
80 ZY(KK)=/Y(KK-l)4GS*CXX 

CALL SY'^B0L(-0.6,-l.l,0.lf 23HGR0UMD TRACK hlR L^7Y 8,0,23) 
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LA^Yy•J - £FU SOURCc STATEMENT - IFMCS) - 

CALL SC;Lc(ZX»9*0fKK,l, 10»0) 
CALL SCALc(Zy,9»0,KK,l,lO»OI 
C4LL LI»;^(^X,2Y,KK,l,l,U) 
CALl SVMBOL(^.$»9»2,0*l,lHNfO»n 
CALL SYM0OL(9.2»^.5,0af lH=,0,n 
CALL SY.M3OL(^.5»,-O*2»0a»lH5,0,n 
CALt Sy^tBUL(-0*2f^»5»0»lf IhWfCtl) 
CALL PLOTCi;>*CfO*0»-3) 

on ci iK«i*L9 10 

31 2Y(KK)«-AR(e,lK) 

CALL SYMBOL(-u*6,-Ul»O*lt30HSTIClC ♦>0SITI0N PlOT F»lft LA^Y dtO.'O) 
CALL SCAL£(^XaO»0,KK, 1,10.7) 
CALL SCaLi(2Y,9*0,KK»l,lQ.C) 
CALL LlM?CitX,iY,KKatO,0) 

CALl AXISC:%0,0*0,19MLAT* PJS* ( 0£GkE6S) ,-l9, lO.O »0.0, ZX( KKf 1) , ;.X( 
iKK^i ) 9 10* 0 ) 

CALL AXISC'J.6,0.0,20HL0NG. ( DftbRScS ) 1 20,9*^., 90*0» ZYCKKiU , ZYC 

CALL SYMBOL CZX(U,ZY(U,e. 1 1 l^tOf-n 
CALL PLOT( l2.0»0.0,-3) 

700 C0i\TIrJU5 

9 IrV=IEV*l 
|T=ST=-10 
6O0 XXXsXCNTC I=V) 
ALL = L 

IF(^LL-XXX)20,7t7 

20 CONTlNUr 

GO ro I 

S CONTINUE 

500 FORMATdS) 

501 FOR.-^AT(12F^.O) 

300 FOftMATdHUUHLAZY 3 UUMBtK FS,0/IH /IH /56X.<rHL5:FT, 3X,5H«IGHr, 
UXtSHLtri6».6X,4HLAT».2X/5h T IKif •hK,4H»0LL, 3X,5HPiTCH,2X, 
27HHlADI *^*.^X,oHALTITU0!:,2X,<;HAr<S'>-.O»3X,3HHPM,^X,3HRPM.<rX, 
33HST* POS*.?XHHST. P0S.,3X.4HTUR>i,3X,2HGS,5X,4rtALTX/lH /) 

301 FM.v.AT(Ff,U2X,F5.0.3X.F5*C»4X.F5*0.6X.F7»C.5X.F5.0,2X,F5»0.2Xt 
lF5»f t6X,F5,l,tX»F5,l,2X,F5.J»lX,Ff»»u,lX.F5»D) 

CALL PLOTi 
STOJ' 
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APPENDIX VII 

MAJOR FUNCTIONS OF 
BARREL ROLL MEASUREMENT 
SUBROUTINE 
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Program 
Subroutine Proper 



Major Functions 

1. Computes maximum and minimum 
points of selected arrays 

2. Computes raw measures 

3. Computes scaled combined measures 

4. Computes "scores" 

5. Calls subroutine "read" and "back" 
and function "amod" 



Subroutine "read" 



1. Reads one record of calibrated data 
(1.2 seconds) 

2. Places variables in common 



Subroutine "back" 



1. Backs-up magnetic tape to the first 
record whose event number is specified 
In the calling vector. 



Function "amod" 



1. Computes roll angle modulo 360 to 

correct for instrumentation Idiosyncracy 
In 0 to 90*" region. 



ERLC 
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APPENDIX VIII 



ILLUSTRATION OF OUTPUT FROM 
EXPERIMENTAL MEASUREMENT PROGRAMS 



ERIC 
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MANEUVER NUMBER 47. 



FLIGHT OF 11-20-69 



PERFORMANCE ANALYSIS FOR LAZY-8 MANEUVER 
I. INDIVIDUAL MEASURES 



s 


HALF-1 


HALF- 2 


S 


HALF-1 


HALF-2 


S 


HALF-1 


HALF-2 


1 


655.81 


248.54 


7 


10.70 


-1.00 


13 


521.62 


521.62 


2 


52K33 


144.52 


8 


0.20 


59.78' 


14 


476.04 


476.04 


3 


1.28 


3.15 


9 


5.64 


17.68 


15 


510.92 


510.92 


4 


728.67 


377.83 


10 


19^63 


13.69 


16 


18.29 


18.29 


5 


0. 


353.66 


11 


17/24 


3.86 


17 


0. 


0. 


6 


84.14 


81.74 


12 


380.16 


380, 16 


18 


0. 


0. 














19 


42.19 


46.13 



SCALED C0M8INED MEASURES 



WEIGHTED 



MEASURE 


HALF-1 


HALF-2 


HALF-1 


HALF -2 


BANK 


81.50 


94.32 


45.51 


41 ,66 


PITCH 


81.77 


90.53 


45.66 


39.98 


R/C 


98.88 


97.34 




R/C 


37.94 


105.80 






AIRSPEED 


78.72 


74.91 


78.73 


79.08 


ALTITUDE 


61.73 


61.73 






ALTITUDE 


64.00 


64.00 






G-FORCE 


100.00 


100.00 






RPM 


77.64 


75.55 







II. OVERALL SCORES 

SCORE HALF-1- 73.64 

SCORE HALF-2' 81.41 

MANEUVER TIME « 72.00 SECONDS 

MAX PITCH 1 - 38. MAX PITCH 2 - 45. MAX ALT - 12148. AT 72. DEC OF TURN 
MIN PITCH 1 « -28. MIN PITCH 2 « -25. 

ANALYZED 402. SAMPLES 1st HALF AND 318. SAMPLFS 2ND HALF. 
NO. RR REVERSALS- 12 NC. PR REVERSALS- 28 



1.256 
33.320 
0.123 
9.700 
18.294 



0.925 
21.095 

0.083 
0. 



0.006 
380.158 

23.325 
0. 



L537 
521.623 



353.662 
476.037 



165.884 
510.923 
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MANEUVER NUMBER 19. 



FLIGHT OF 12-17-69 



PERFORMANCE ANALYSIS FOR BARREL ROLL MANEUVER 



I. INDIVIDUAL MEASURES 



s 


MEASURE 


S 


MEASURE 


S 


MEASURE 


1 


16693.30 


7 


25.82 


13 


13579.30 


2 


14042.13 


8 


16.24 


14 


2.07 


3 


3.76 


9 


0. 


15 


0. 


4 


5.30 


10 


0. 


16 


0. 


5 


0.34 


11 


1139.60 


17 


0.70 


6 


46.37 


12 


434.86 


18 


20.04 



SCALED COMBINED MEASURES 



MAIN PARAMETERS 


MEASURE 




ENTRY AIRSPEED 


100.00 




ATTITUDE (1) 


44.36 




ATTITUDE (2) 


53.19 




ATTITUDE (HDG.) 


39.36 




AHITUDE (PITCH), 


75.72 




ATTITUDE (ALT.) 


73.76 




ATTITUDE (TOT.), 


79.61 




RPM 


79.28 




G-FORCE 


99.06 




ROLL-RATE 


98.66 




ATTITU'iP (3) 


54.74 




, OVERALL SCORE- 


71.99 




MANEUVER TIME « 


25.00 


SECONDS 


101.42 


100.86 


-99.64 


100.52 


100.17 


98. S8 


-33.72 


-47.00 


3.76 



104.28 
8.89 



100.52 
21.18 
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1.00 tUOO 21.00 



ai.oo 



«1.00 S1.00 
TINE (SECONDS) 



Ol.QO 



71.00 



01.00 



01.00 



101.00 



Plot 3 



noLt mo f I1CH vs. mc raiucr o 



ERIC 
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I 
I 
i 




n.jmmxm% Plot 15 



erIc 
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mntm vc toc r* un t 



TtHE (SeCONDS) 

Plot 19 




HMVCtt Vt. TM r A UttT « 



Plot 20 



ERIC 
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f 



8 
8t 



8 

to 

§8 

x: 



12-19-69-29 
Fair 




incx rmnm r%mmum% 



«.« 



Plot 21 




'-10O.O0 -80.00 



H 

-60.00 



-H 

-00.00 



-20.00 0.00 

ROLL (DEGREES) 



20.00 



-H 

uo.oo 



60.00 



80.00 



—I 

lOO.OO 



Plot 22 



ROLL VS. PITCH FOR LAZT f) 
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8 



CO 

iij8 

Ss 

UJ 



8 



riTCH 0 




'1.00 



9.00 



17.00 



25.00 



33.00 VI. 00 

TIME (SECONDS) 



V9.00 



-H 

S7.00 



65.00 



—I 

73.00 



— I 
81.00 



ROLL AND PITCH VS. TIME FOR tfllT 8 



Plot 23 



^ 

333 



AFHRL-lR-72-6 




ar:TMt vt. To< ret • 



Tire (Scc8nS) 

Plot 24 




Plot 25 
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i 



! 
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9 




Plot 40 



ERIC 
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8 

84 1- —I • 1 i I 1 1 1 1 

-moo -ic.oo -60*00 -w.oo -20.00 0.00 20*00 «o.oo oo.oo lo.oo too 

ROLL (DEGREES) 

Plot 42 

noLL vs. f ircH rm lazt a 
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APPENDIX X 

STICK POSITION PLOTS FOR REPRESENTATIVE 
LAZY 8 MANEUVERS 



ERJC 
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St 





g 11-20-69-49 (Hxc.) 

84 — — ■■< ■ 4 ♦ < f 1 1» • 1 { 

-90.00 -70,00 -S0.OO «>a0.00 -t0.fO 10.00 ».00 50.00 70.00 SO.UO tso.oo 

ROLL (OEGREES) 



8 
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11-20-69-54 .(Hi. Good) 

H • 4 -4 • 1 H 1 -I 

-70.00 -SD.00 -90.00 *10.00 lO.OO 90.00 90.00 70.00 ».00 110.00 

ROLL (DEGREES) 



8 




f-i 1 — « 1 « 1 1 I 1 1 1 

-90.00 -70.00 -50.00 -30.00 -10.00 lO.OO 30.00 50.00 70.00 90.00 110.00 

ROLL (DEGREES) 



8 

8 

-90.00 



BOa vs. PITCH FOft LflZT 8 
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uj8 



o 



8 



8. 




-100.00 -00.00 



— I 

-00.00 



n -20-69-50 (Good) 



-«l.00 



-20.00 



0.00 



mx. COEGBEESl 



20*00 



00.00 



•0.00 



n.00 



100.00 




WLL vs. riTCHFonuaY 0 
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8 

CO 
UJ 
lU 




•8 



8 

8 

Si 



8 
8 

-^.00 



11-20-69-59 (Good) 



-2D.Q0 

nOLL lOEGRFES) 



20*00 tO*QO CO. 00 iO.OO 



10O.0D 




-SO.0O 



-IJ.OO 10.00 

ROLL (DEGREES) 



50.00 



110.00 



nOLL vs. PITCH fm LAtr 8 



ERIC 
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8 

s 

o 

o. • 

g 

8 

8 



8 




1 • 1 1 1 1 1 1 1 I 

-90.00 -70.00 -S0.0O -30.00 -tO.OO 10.00 30.00 50.00 ' 7O.0O 90.00 UO.OO 

ROLL (DEGREES) 



nOLL vs. PITCH rOP tJttf S 



ERIC 
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APPENDIX XIII 
PUNCH AND PRINT PROGRAM 



ERIC 
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PUNCH AND PRINT PROGRAM 



This program prints at At = 0,5 and punches cards at 

'0,4, Barrel Roll and Others 
0.5, Lazy 8 



At 



Input CrDS: (1) $ Setup A A{3) AAAA T37DXX, H^^RING 

(2) Month, Day, Year- 

(3) N 

(4) KODE = 



+ Lazy 8 



or othFr maneuver 

0 



(5) evno 

(6) Duration 
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KNCCP 

LAZYY3 - zfU SOURCf-' STAT£M5NT - IftAS) ' 



CPRINT HfASURc VAPIABLrS FOR I AZY £ M\NwlVf:R 
Clf'rNSIO^i AR(. 0,^500 ) 

^ CI^'C^SI(;^^ pih(25) 

CI^'S^SIO'^ xcmc?) 
iccuNr=4 

■ IEV=1 

RE AC (5. 5011) IMO-^t lOAVt lYR 
5011 FCRr'M(3I5) 

R6AC (5,50C) N 
PcAC(5,)S0»)(INM(I)t I^ltN) 

1501 Fc^^'^r( 1215)' 

REAC (5,50.) ( EVNOC I ), 1= Wi» 
601 RfAC (5,50x) (XCNT( I )t I = ;.tN, 
4030 CGNTlXUc 
IT = ST=-*.0 

1 REAC(.6) ((/.(I, J), 1 = 1, 120), J = l, 9) 
RcAC( -.6 ) ( (B( I, J ), 1 = 1,12 )f J = l,2?) 
CC ?C 1 = 1,..? , 
X=AyCC(B(I,18),100Jo) 
IF( IT=ST)97:0,5,5 
9710 CCNTlSUe 

IF(EVNO( I£V)-X) 2,3,2 

3 IF( ITzST) 4,5,5 

4 VxRITE(d,350)IMON,ICAY,IYR 
WRITG(6,300)HVNG(IEV) 
ICCUNT=4 

6751 WRITE(7,6760) IVON, ICAY,I YR,£VNO( ILV) 
6760 FCRr'iSK I 5 , 1 5 , 1 5 , F7. 0 ) 
6750 CGNTINUi: 

XcRPT=EVNC( lEV) 

L=0 

TIME'O.O 
ITEST=0 

5 IA=XCM I-l) + l 
L = L + 1 

6C0A CCMI.NUe 

IF(L-i)e20,f^20,321 

821 IF(A(IA,6))8?2,326,826 

826 IF(A(IA,6)-?50.)827, 82'',B22 

827 IF(AeS( A( IA,2) )-36C. )9AU,94r.,^22 
9411 lF(e(I,6) )t2?t82£,8r.O 

822 CC 823 MOM=l,iO 

823 AR(^'C^',L):^AR(y.OM,L* i ) 
GC TC di4 

820 CCNTI.XUE 

AR(i,L)=A( lA,^) 
AR(2,L)=A( lA,^) 
AR(3,L)=B(I,7)^ 
6005 AR(4,L)=B( 1,6) 
AR(5,L)=A( IA,6) 
AR(6,L)=B(I,:5) 
AR(7,L)=B( 1,36) 
AR(8,L)=AI IA,3) 
AR(9,L)=A(IA,4) 
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'Win 07/. 0. 

: /vv - S^:Lf^C: $T^TC-M£:>T - !PN(S) - 

^ ^ ;.<n 

/ t i u )/ . C 

i/. } ■ - L) 

. ( .« A: i -,1. )-\^( ■, ' ) ) 
Ia*'^^ I ■• .rj I ( ■ I } I V<: ■» ), TU^'^i M.TX ,A!^. (.' OfL ) 

7 • " - - ; i ^ « 0 . 1 

ft. 6.)o 
£0i !(:t i>\r = icc^HT^ - 

GC I'* f. 
?. ( .-^J V.S /,7 
7 r= ( 6,73: . ) 

tr T( 

7729 CC''.Tif.J; 

675)5 L X -L/ J » 
w > C I I ) / « . 

^.'^ IT: ( 7, l:*.:^. ) ( ( S JC ) , ^ ( » JC) » A'^ ( j> : JC ) » AK ( 4 » JC ) t A*^ ( 5 ♦ JC ) t 

rc re 7.)'^ 

I'jZ?. Mil 

'a i I ' ' ( • ;( ( ^f<( P< , JC ) , l;( = , : ) , JC - , L , NO • L ) 
6754 f C'^?■':^ f^.'^ ,J .0tr--;.P,^:7.0,r T.-J.F'^.Of ^^.0fF^.0^F7.Cf F?.0rF5.0r 

I f . C t f " . ' . . 0 f F ' . V ) 
6752 r ' • !mU- 

700 r^v: iM)" 

9 f "V^ • ' 

600 > is' v: ^ J i V » 
L L L 

c ' (.' . 
500 r : I 

H'?0 . : ^"^.n { J"), '^hli^./ I'J"^:^ F5.0/iH /IH /56X r4HL£F T t 3X ,5HRtGHT » 

I ' < » -hi.'..'^ , ^i'LAl . , '-IK/V'i 1 H:, AX.AMROLL »3X,5HPI TCH ,:x , 
?7 ♦ - -ir i <G, .>X, ibftLT IT'vjO't .'X,dF.M^$P£ = f)»3X,5hf<P.M,4X,3HRPV,4X, 
M*r . ^. : T'X, 3''^ST . ^r, . , X , '>HT'J» i , 3X , ;HG S , 5 X , 4H AL T X , 5 X , 4H ACc L / 

4 » ' / » 



368 



AFHRL-TR-72-6 



' 07/. 6/ 

tAZYY8 - EFN SOURCE STATEMENT - IfUiS) • 

301 FCRM^T(F6.l,2X,F5.0,3X,F5.0,^X,F5.0,6X,F7.C,5X,F5.C,2X,f=5.0,2X, 

IF5.0,6X,F5.1,6X,F5.1,2X,F5.0,IX,F6.0,1X,F5.0,2X,F6.2) 
350 FORf<^T(lHl,20X,29HCATA PRINTOUT FOR FLIGHT OF I 3 tlH- 13 , IH-1 3/ 
1 XH / ) 
STOP 
ENC 



J69 



AFHRL-TR-72-6 



RECORDED VALUES' • 
EVENT 47 (11-20-69) 



TIME 


ROLL 


PITCH 


HEADING 


f 

ALTITUDE 


AIRSPEED 


0 


0 


5 


360 


9586 


200 


5 


-8 


22 


359 


9940 


185 


. 10 


-26 


36 


358 


10713 


156 


15 


-61 


34 


340 


11536 


118 


20 


-90 


2 


308 


11772 


101 


25 


-62 


-26 


251 ■ 


11468, 


132 


30 


-29 


-21 


215 


10677 


169 


35 


- 7 


- 3 


201 


10218 


197 


40 


0 


19 


201 


10324 


182 


45 


21 


40 


218 


11030 


148 


50 


67 


41 


255 


11806 


103 


. 55 


82 


2 


304 


12148 


88 


60 


48 


-24 


344 


11772 


124 


65 


18 


-17 


358 


10996 


167 


70 


3 


- 1 


360 


10465 


193 



Recorded values shown here at 5 second intervals; actual print-outs 
showed values at 0«5 second intervals* 
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Flight 


GF- 11-20-69, 5VN0 


47 




PITCH 




ADC O 




: 


5.00 






0 • 


• 


12.67 
25.53 


-2.80 


197.05 
179.60 


177 •39 




33.00 
25i33 


-«.80 
-73 .74 


134.30 
106.14 


1517.40 

2079 .19 




12.67 

Oi 


-83.75 
-90.68 


100.42 
101.70 


2175^80 
2186^00 




-9.00 
-18,00 


-83.54- 
-79.46 


105.52 
115.07 


'2206.45 
2158.34 




-27.00 
-18.00 


-5Ii.0O 
-23id6 


141.75 

176i00 


1646.00 
914.01 




-9i00 
6. 


-13.00" 
-5.50 


192; 00 
197.86 


667i00 
596*00 




15.00 
30.00 


-0.57 
9.00 


187.76 
162.99 


646.37 
1049.37 




45.00 
30.00 


46.67 
78 .37 


120.67 
92.63 


1933.33 
2392.76 




15.00 
- 0. 


83.00 
81.03 


87.00 
88.79 


2557.92 
2557.91 




-3.33 
-16.67 


76.81 
66.97 


94.20 
103.10 


2515.37 
2469.79 




-25.00 
-16.67 


40.00 
17.28 


135.00 
169.44 


2051.00 
1387.86 




-3.33 
_2.00 


8.37 
2.00 


186.00 
195.00 


1099.56 
879.00 
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FLIGHT OF 11/20/69 
6NV0 47"" kTleFt ") 



AIRSPEED CCNPUTATIONS 



NO. 


ERROR 






L 






1 


0. 


SUM"Ci-5I « 18.00 










2 


0. 












3 


0. 


SUMCl-3) 0. 










4 


-13iOO 












5 


-5.00 


SUMf3-5) - 18.00 












EXCURSION 


TIME RATE 










1 


100.000 


19.0 5.3 










2 


100^000 


17.0 5.9 










3 


113.000 


17.5 6.5 










4 


108.000 


18.0 6.0 











ERIC 
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APPENDIX XVI 

6EBRIEFIN6 PLOTS FOR 
FOUR LAZY 8 PERFORMANCES 
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LAXY 8 



IP Rating: ■ Excellent 
Direction: Left 



11-20-69 
ENVO- «7 
LEFT) 




16.00 



32.00 48.00 M.OO 

TIME (SECONOS) 



80.00 



96.00 
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LAZY 8 



IP Rating: 
Direction: 



Excellent 
Left 



11-20-69 
(t| LEFT) 



o«4 



in 



o 
o 



5g 



O 
O 



I 



o 
o 



w> 
I 



SLOW ROLL RATE 
AT ENO OF 
FIRST QTR. 




PITCH-UP TOO RAPiO AND TOO LARGE; 
CAUSED AIRSPEED TO DROP BELOW 
100 KNOTS 



ATC LINEARIZED 
, CRITERION 
ESTIMATE 



Is^ STOPPED ROLL 
^ INCREASE TO 
SALVAGE 
AIRSPEEO 



fl 

NOSE LEVEL 
PRICR TO 
WINGS LEVEL 



CONTINUED TO 
INCREASE ROLL 
AFTER PITCH 
BECAME ZERO 



71 1 

'-120.00 -80.00 



PITCH DOWN INSUFFICIENT 
TO RECOVER LOST AIRSPEED 



-40.00 0.00 40.00 

ROLL (DEGREES) 



80.00 



120.00 



ERLC 
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LAZY 8 



IP Rating: Excellent 
Direction: Left 



g . 11-20-69 
o . ENVO- i|7 

S-t (4 LEFT) 
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LAZY 8 

IP Rating: Good 
Direction : Left 



11-18-69 
ENVO- U 
(3 LEFT) 




16.00 



32.00 48.00 6U.00 

TIME (SECONDS) 



80.00 



96.00 
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UZY 8 



IP Rating: 
DIRECTION: 



Good 
Left 
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^ CO 
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Ui 
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uJo 
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11-18-69 
ENVO- U 
(3 LEFT) 



PITCH TOO SHALLOW; 
HIGH AIRSPEED 



ROLL/PITCH COORDINATION 
NOT SMOOTH 




LETS PITCH FALL 
OFF TOO RAPIDLY 



CONTINUES TO INCREASE 
ROLL AFTER ZERO-PITCH 



'•120,00 -80.00 



ROLL-OUT RATE EXCESSIVE 



-vo.oo 0.00 no. 00 
ROLL (DEGREES) 



80.00 



120.00 
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LAZY 8 

IP Rating: Fair 
Direction: Left 



ENVO- 65 
C2 LEFT) 



in 

CM- 
CM 



o 
o 



REACHES MAX PITCH TOO RAPIDLY: FINISHES 
FIRST QUARTER WITH HIGH .AIRSPEED 




CM 



in 

I- 
o 

Zo 

o 
in- 

UJ 
UJ 

(Oo 
OC • 



FAILS AIRSPEED CRITERIA AT 
MIDDLE OF MANEUVER AND END 



ROLL z -90 
PITCH = 6 



ROLL = 94 
PITCH = 6 



in« 



^ * 00 16.00 32.00 48.00 64 . 00 

TJME (SECONDS) 



80.00 



98.00 
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LAZY 8 



IP Rating: 
Direction: 



.-air 
Left 



in 



UJ 

UJo 



3^0 



0- I 



I 



IP 
I 



I 



12-19-69 
ENVO- 65 
(2 LEFT) 



HOLDS NOSE UP WITH RUDDER WHILE 
CONTINUING TO INCREASE ROLL 




CONTINUES TO INCREASE 
ROLL AFTER PITCH 
BECOMES ZERO 



120.00 -80.00 



ROLL/PITCH COORDINATION NOT 
SMOOTH; ROLLS OUT TOO RAPIDLY 



-UO.OO 0.00 40.00 

ROLL (DEGREES) 



80.00 



REACHES MAX 
ROLL BEFORE 
PITCH BECOMES 
ZERO 



120.00 
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LAZY 8 



IP Rating: 
Direction: 



Fair 
Left 



o 
o 



12-19-69 
ENYO- 6S 
C2 LEFTl 




T).00 



16.00 



-I 1 r 

32.00 118.00 64.00 

TIME (SECONDS) 



80.00 



96.00 
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LAZY 8 

IP Rating: Unsatisfactory 
Direction: ,Left 




ERIC 
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LAZY 8 

IP Rating: Unsatisfactory 
Direction: Left 



12*- 19-69 
ENVO- 66 
(1 LEFT) 




I * I 1 i I T f 

-120.00 -80.00 -UO.OO 0.00 110.00 80.00 120.00 

ROLL (DEGREES) 
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LAZY 3 



IP Rating: 
Oinection: 



Unsatisfactory 
Left 



ENVO- 66 
(1 LEFT) 




CM* 



OfilH z 8U3 FT 



J -1 1 -I 

()• 00 16. 00 32. 00 48. 00 611. 00 

TIME (SECONDS) 



80.00 



96.00 
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ROLL 



PITCH 



ALT. 



200 




12700.- 



11900. 



7-10-70 
ENVO- IS 
(2 LEFT) 



0.00 8.00 



16.00 



24.00 
TIME 



32.00 



— I 1 

UO.OO 48.00 
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7-10-70 
ENVO- 15 
(2 LEFT) 



ROLL r 180 



ROLL = 



ROLL-PITCH PLOT 
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80.00 160 00 240.00 3^0 

ROLL 
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REPRESENTATIVE BARREL ROLL PLOTS 
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(PILOT'S COMMENTS) 

"This will be Barrel Roll No. 1, Event 36. The trouble in barrel rolls 
is essentially the same troubles as we have in lazy 8*s. Student.enters 
with the nose low, gets the proper parameters, starts his turn off, 
turns back up, is through straight and level flight with bank still in. 
Way too much pitch during this half of the maneuver. Not enough back 
pressure, too much bank. He is not very far off the point to the other 
side, rolls back up and is back to straight and level flight near his 
original point; however, if the whole maneuver were shifted up, that 
would be a fair maneuver." 
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12-19-69 
ENVO- 36 
(2 LEFT) 




CM 




>i0.00 80.00 120.00 160.00 

RBS-ROLL 



200.00 21(0.00 



ERIC 
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(PILOT'S COMMENTS) 

"Barrel Roll No. 6, event No. 59. The nose is below the point. 
Turn off. Our reference point about 20--30**. Begin the maneuver 
itself. This time, something that is fairly common for students to 
do is not to make allowance for the change of airspeed in the rate of 
roll that is required. Here I am not changing the aileron pressures 
as a result the rate of roll is slowing down, and as we come out of 
the bottom of the maneuver the rate of roll increases and we wind up 
making a bigger maneuver -than we should have and kind of dishing out 
at the bottom and that would have been a fair maneuver." 
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(PILOT^S COMMENTS) 

"This will be barrel roll 2, event No. 37. This one again has the 
nose below the point, turns off a given distance, comes through straight 
and level flight. Gets a pretty fair start of the thing, not enough 
back pressure during the first part, consequently the first half of the 
maneuver is flattened out; he has to roll much too rapidly to get his 
nose through at the proper attitude. He continues to roll too fast and 
winds up flattening out the bottom part of the maneuver. He has basic 
idea that he is flattening it out too much.*' 
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(PILOT'S COMMENTS) 

"Barrel roll 5, event No. 40. Nose below the point coming up on our 
entry airspeed; in this one again you have got the real tiger flying the 
airplane. Basically a little too aggressive with it. He is pretty 
smooth with the controls. But he flies a very tight, very aggressive 
barrel roll which is fine as far as aggressiveness goes but it does not 
quite look like a barrel roll is supposed to look, and that would be a 
fair maneuver." 
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(PILOT'S COMMENTS) 

"Nose below the point entering, turns off much too far, back through 
not in straight and level flight, essentially winds up flying a loop 
around his point. The nose is much too far off the point; a little 
bit of burble on the top and we are back up. However we are about 60 
or 70'' off our point, and that would be an unsatisfactory maneuver also." 
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(PILOT'S COMMENTS) 

"Turn back around to the west. This will be barrel roll No. event 
No. 62. This is the student who makes a reasonably good entry for the 
maneuver. Rolls the nose around' his point, turns off, and then starts 
to roll initially with way too much back pressure and then just rolls 
easing up on the back pressure. As a result the nose never quite gets 
back to the horizon at all and you wind up at the original entry point. 
However, you have never descended at all and never made the lower part 
of the maneuver look anything like it's supposed to look. That would 
have been an unsatisfactory." 
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(PILOT^S COMMENTS) 

"This win be event No. 55, barrel roll 3. The nose is below the 
point. A lot of times when the student knows the maneuver he will turn 
off the point, do a pretty good job, look away for a minute and lose 
his reference point so that he winds up coming way over beyond the point 
coming through level flight with the bank indication, and because of this 
the nose comes well down below normal. He has to use a little higher 
rate of roll to come out at the bottom. Little more g's than necessary, ^ 
way dished out. And that would have been an unsatisfactory barrel roll. ' 
Turn around and work back up toward. the northwest momentarily." 
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(PILOT'S COMMENTS) 

"This will be barrel roll No. 5, event 57. Nose below the point, off. 
This time he rolls much too fast to start with. He is flattening out 
the maneuver much too much across the top. The nose is off the far side 
about as far as it should be, however, in here he is not rolling off 
nearly fast enough and 9 times out of 10 cases, he will wind up what we 
consider to be a high speed dive recovery. That would have been 
unsatisfactory." 
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(PILOT *S COMMENTS.) 

"The barrel roll is much easier to mess up on the entry than even this 
one is. This one will be barrel roll 10, event 69. Driving around 
he wants to do a barrel roll, again they just make up their mind. ^ The 
airspeed is already 230 knots as a maximum entry airspeed. They pick 
out their point, lower the nose below the point. The airspeed is 
already 240. Then they lower the nose, start to do the maneuver, 
come up with much too much airspeed, 250, 260, 270, they worry about 
the airspeed, getting the nose way up too high. Generally disorganized. 
That would have been an unsatisfactory." 
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(PILOf^S COMfCNTS) 

"The most common tendency on the barrel roll for an unsatisfactory 
maneuver is what we are about to do, barrel roll No. 8, event No. 61 ♦ 
and that is flattening out across the top like we have shown before, 
with the rate of roll a little too slow in the second quadrant, winding 
up coming through the horizon with bank still and the nose coming much 
too low. Winding up with essentially a high spoed dive recovery. 
And I am getting myself into an area, headingwise, that I should not 
be in on those." 
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